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1 Introduction 

Given a probability space {n,J^,P) with a right-continuous filtration {J^t)t£[o.T], we consider a stochastic re- 
gression model specified by the following equation : 



X 



Yt = Yo+ f fisds+ f b{Xs,a)dWs, t e [0,T], 



I where {lt}o<t<T = {{Yt^ fY^)}o<t<T is a 2-dimensional J^t-adapted process, {Wt, J^t}o<t<T is a 2-dimensional 
I . standard Wiener process, b = {b^^)i<i,j<2 '■ K"^ x A ^ is a Borel function, {jit} and {Xt} are Tt- 
' progressively measurable processes with values in and M"^ , respectively, cr € A, and A is a bounded open 
subset of M"i. In the case that /if = ii{t,Yt) and Xt — {t,Yt), then {Yt} is a time-inhomogeneous diffusion 
process. 

Our purpose is to estimate the true value cr, of parameter cr G A by nonsynchronous observations {y^iji. 



s* 

si i-^TiSj "''^'-'-^ \^'-T-j}j,k- In our setting, {fit}o<t<T is completely unobservable and unknown. 

The problem of nonsynchronous observations appears in the analysis of high-frequency financial data. Re- 
cently, as availability of intraday security prices gets increase, the analysis of high-frequency data becomes more 
significant. In particular, the realized volatility has been studied actively as an estimator of security returns' 
volatility. 

In the study of portfolio risk management of financial assets, the quadratic covariation of two security log- 
prices is also a significant risk measure. Therefore estimation of quadratic covariation with high-frequency data 
has also been studied by many authors. One problem of estimation is nonsynchronous trading. The observation 
times of two different security prices do not necessarily coincide. 

If Y^ and are synchronously observed at some stopping times {S^}, then the realized covariance between 
Y^ and converges to {Y^,Y'^)t in probability as max^ 15* — S'^~^\ -^^ 0. When observation times of Y^ and 
Y^ arc nonsynchronous, to calculate the realized covariance, we need to synchronize the data by some method. 
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However, the realized covariance has serious bias if we use a simple synchronizing method such as previous-tick 
interpolation or linear interpolation. Epps first indicated this phenomenon by U.S. stock data analysis, and 
this phenomenon is called the Epps Effect. 

To solve this problem, Malliavin and Mancino [33] proposed a Fourier analytic method, and Hayashi and 
Yoshida [13] proposed a estimator based on overlapping of observation intervals. In sequent papers, Hayashi 
and Yoshida |16|.|17| studied the asymptotic distribution of estimation error of their estimator and proved 
asymptotic mixed normality. There also exist some works about estimation of the quadratic covariation with 
nonsynchronous data contaminated by market microstructure noise. We refer the reader to BarndorfF-Nielsen et 
al. [3] for a kernel based method, Christensen, Kinnebrock and Podolskij [5] for a pre-averaged Hayashi- Yoshida 
estimator, Ait-Sahalia, Fan and Xiu [5] for a method with the maximum likelihood estimator of a model with 
deterministic diffusion coefficients, Bibinger [S],[B] for a multiscale estimator. 

With respect to the problem of nonsynchronous observations, essentially nonparametric approach has been 
studied. In this work, we use a quasi-likelihood function, that approximates the likelihood function in diffusion 
cases and construct a quasi-maximum likelihood estimator and a Bayes type estimator for a parametric stochastic 
regression model with nonsynchronous observations. The asymptotic behavior of estimators will be investigated 
when time end T is fixed and max^j- \S^ — S'*~^| V \T^ — T-'^^l in probability. Hence our method can be 
applied not only to estimating the quadratic covariation but also to identifying nonlinear structure of process 
Y. 

There exist many studies about asymptotic theory of parametric estimation for stochastic differential equa- 
tions with high-frequency data. Among many studies in a long history, we refer the reader to Plakasa Rao 
[2H])[2n], Yoshida [55] , [37] , [SE] , Kessler [55] under ergodicity, Shimizu and Yoshida [21], Ogihara and Yoshida 
[27] for jump diffusion processes, Masuda [55] for Ornstein-Uhlenbeck processes driven by heavy-tailed symmetric 
Levy processes, S0rensen and Uchida [32], Uchida [33], [34] for perturbed diffusions, Dohnal f9^, Genon-Catalot 
and Jacod [2], [13], Gobet [14], Uchida and Yoshida [35] for the fixed interval case. 

One of the most useful approaches to study asymptotic behaviors of quasi-maximum likelihood estima- 
tors and Bayes type estimators is the theory of random field of likelihood ratios initiated by Ibragimov and 
Has'minskii [T2]-|2D]- Their theory enabled to reduce the problem of asymptotic behaviors of estimators to 
more tractable properties of the random field of likelihood ratios. In [5D], they applied their theory to inde- 
pendent observations and white Gaussian noise models. Kutoyants [23], [24] developed Ibragimov- Has'minskii's 
theory for diffusion processes and point processes. Yoshida [35] investigated polynomial type large deviation 
inequalities to apply Ibragimov-Has'minskii's theory and discussed consistency and asymptotic normality of 
quasi-maximum likelihood estimators and Bayes type estimators for ergodic diffusion processes. This scheme 
was also applied to jump diffusion processes in Ogihara and Yoshida [37], Ornstein-Ohlenbeck processes driven 
by heavy-tailed symmetric Levy processes in Masuda , and diffusion processes in the fixed interval in Uchida 
and Yoshida [35] . 

In this work, we construct a quasi-log-likelihood function for the stochastic regression model with nonsyn- 
chronous observations. Then we will show consistency, asymptotic mixed normality and the convergence of 
moments of the quasi-maximum likelihood estimator and the Bayes type estimator with aid of polynomial type 
large deviation inequalities. The advantage of our approach is to obtain asymptotic mixed normality, exact rep- 
resentation of asymptotic variance and convergence of moments of the estimators. The convergence of moments 
of the estimators is important, e.g., when we investigate the asymptotic expansion and the theory of information 
criteria. Moreover, our method does not require any synchronization methods. 

In the case of synchronous and equi-space samplings : S'* = T' = iT/n, Gobet [T3] showed local asymptotic 
normality of the likelihood function of observations and obtained the asymptotic lower bound for the variance 
of estimators. The estimator proposed by Genon-Catalot and Jacod [T^ attains this bound. In the case of 
nonsynchronous observations, we expect that local asymptotic mixed normality of the likelihood function holds 
and our estimators attain the lower bound of the variance of estimators since our quasi-likelihood function seems 
to be asymptotically equivalent with the 'true' likelihood function and our quasi-likelihood ratio has a LAMN 
type limit distribution. However, these problems are not proved in this paper and left as future work. 

This paper is organized as follows. In Section 2, we construct a quasi-log-likelihood function _ff„ and discuss 
its non-degeneracy. Section 3 gives the asymptotic behavior of Section 3.1 deals with two equivalent 

conditions of the asymptotic behavior of observation times {S*'} and {T^} to control the asymptotic behavior 
of Hn- In Section 3.2, we specify the limit of iJ„ and estimate the rate of convergence. Section 4 studies the 
degree of separation of the limit of Hn , which is necessary to prove asymptotic properties of the quasi-maximum 
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likelihood estimator and the Bayes type estimator. We also introduce sufficient conditions for the condition 
of separation. In Section 5, our main results about asymptotic properties for estimators are stated. Section 6 
introduces easily tractable sufficient conditions for assumptions about the observation times in main theorems. 
Proofs are collected in Section 7. 

2 Construction of a quasi-likelihood 

In this section, we define a quasi-log-likelihood function Hn to construct a quasi-maximum likelihood estimator 
and a Bayes type estimator. 

First, we define some notations. For a real number a, [a] denote the maximum integer which is not greater 
than a. For a matrix A, A* denotes transpose of A and || A || represents the norm of A as a linear map. We 
regard a p-dimensional vector v as a p x 1 matrix. £p denotes unit matrix of size p. We set sup0 = — oo, 
inf = +0O and 2N = {2k; k G N}. For M e N and K C K denotes the closure of K. For a set K C Q, 
K'^ denotes the complementary set of K. For an interval K C [0,r] and a stochastic process {Xt}o<t<T, we 
denote L{K) = inf K,R{K) ^ supA', X{K) = X^^^k) ~ X^k), Kt ^ K D [0,t) and \K\ = R{K) - L{K). Let 
cr) = {¥^{x,a),b^'^{x,<7))* (i ~ 1,2). For a vector k = ,km), we denote ~ ( a^- ^--dK )iu---ik=i- 

We denote \x\^ = 'E^^.■■^M \^n,-iM? for x = {xi,^...,^,}^,^...^^^ . 

Let A satisfy Sobolev's inequality, that is, for any p > ni, there exists C > such that 

supKa;)|<C ^ \\d'M'^)\\p 

k=0,l 

for u G C^{X). It is the case if A has Lipschitz boundary. See Adams [T], Adams and Fournier [5] for more 
details. 

We recall the definition of stable convergence. Given an extension (il, J^, P) of {il,T,P), let {X„}„gN and 
X be random variables on (17, J^, P) with values in a metric space E. Then we say that X„ stably converges 
in law to X, and write X„ -^-"^-^ X, if i?[Y/(X„)] — > i?[Y/(X)] as n — >■ cxj for any bounded continuous function 
f : E —i'M. and any bounded variable Y on J^). See Jacod [H] for more details. 

For 1 < k < 712, let observations {5*'}^, {T^j and {T^}j,k arc strictly increasing with respect to i or j 
almost surely and satisfy S° = T° ^ = 0, S' = mf{t > 0; >i}AT, = inf{i > 0; > j} A T, and 

= M{t > 0; Nt+'^ > j}AT for i,j > 1, where {N^}t, {Nf}t and {N^'^'^jt are simple point processes, that is, 
{N^} is a cadlag Z+-valued stochastic process whose jumps are equal to 1 and Nq = (1 < < "-2 + 2). These 
observations and point processes depend on a positive integer n £ N. Let n — n„ = {{S^)i, {T^)j, {T^)j,k), 
l„ = + 1, nin = + 1, m'^ = N^'^ + 1 for 1 < fc < ?i2, then ln,mn, {wfil/Jli are observation counts. We 
also assume {n„}„gN are independent of Jr- Denote P ~ [5"^^, 5**) (1 < i < In), = [T^^^,T^) {1 < j < m„), 

r„ = maxflPI V IJ-''!) V max max IT? - 7? I, 

i,j l<fe<«2 l<i<m^ * 

and Tj^{K) = ma.x{T^;j G Z_|_,7^-' < L{K)} for 1 < fc < ^2 and an interval K C [0,T]. Let {&ri}„£N be a 
sequence of positive numbers such that 6„ > 1 (n g N) and 6„ — > oo as n — > cxj. {&„} represents order of 
observation counts. Conditions for {&„} are given in [A2-g,(5], [A3'-q,ri], [A4:-q,5] later. 

For a function g : M"^ x A R, let gt = g{Xt,a),gt,* = g(Xt,cr,), gK,t = g{{Xtj-,^j^-^^Jk,cr) and gK = gx.T 
for interval K <Z [0,r]. We use the symbol C for a generic positive constant which is independent of n and p, 
and is varying from line to line without specially stated. 

We assume the following conditions. 

1. The mapping b : M"^ x A ^ E^® E'^ has the continuous derivative di.dl,h and 3^6 can be continuously 
extended to R"i x A for < j < 3 and < i < 4. Moreover, 

snv\didlb{x,a)\<C{l + \x\f 

cr6A 

for < j < 3, < i < 4 and X e R"^ 
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2. bb*{x, a) is elliptic uniformly in (x, a) G M"^ x A, that is, there exists e > such that det bb*{x, cr) > e 
for {x, cr) G X A. 

3. \b{x,cr) -b{y,cr)\ < C\x - y\ for x, y G and cr G A. 

4. Yo e n,>oL%n). 

5. There exists 7 G (0, 1) such that 



sup £;[|Mtn<oo and sup ^^'f* 

0<t<T 0<s<t<T |t — S|'" 

for any g > 0. 

6. There exists 713 G 2+ such that {Xt} can be decomposed as 



< 00 



where 



Xt — Xq 



bl^b'+ / bl^ds 



bids 



bUW, 



bl'dW., 



btdW., 



bl'dWs, (* = 2,3) 



{6J}o<t<T (1 < i < 3) and {i>'t}o<t<T (2 < i < 3, 1 < j < 3) are J^j-progressivcly measurable 
processes, {Wt, J^t\Q<t<T is an na-dimensional standard Wiener process independent of {Wt\ and 
i?[supQ<t<j.(|6j^ I V l^tl V lATol)''] < 00 for any i, j and p > 0. Wc ignore the terms bl, J* b^dWs and 
/p 5f dM^s when = 0. 

Our setting contains the case where {Xt} or Yq depends on a and main results hold in this case. However, if 
{Xt} or Yq depends on cr, our estimator (T„ may not be the quasi-maximum likelihood estimator since we need 
to consider the density of observations {XjLj} or Yq. Nevertheless, we use the terms "quasi-maximum likelihood 



estimator" and "Bayes type estimator" in this case. If ATt 
is the maximum likelihood type estimator. 
Under [^1] 2, there exists e > such that 



(t, Yt) and Yq does not depend on a, we can see (T„ 



detm) = \bim'il^p^)>e 



for p(x,cr) = b^ ■ b^\b^\-^\b^\-^{x,a). Therefore 



p = sup \pt\ < 1 
te[o,T],creA 



(1) 
(2) 



by [Al] 1. 

Let us denote 



V 



diag({|6}in/) 
51 . 62 



bj-ti 



\in.J\ 



die.g{{\b'j\'}j) 



I.J 



.11 



and define a quasi-log-likelihood function H,, = iJ„(cr) of {{Y^ (I) / V\T\)*i , (Y'^iJ)/ 



Y\I) 



Y\J) 



s- 



Y\I) 



J\ 



J\):j) by 
1 



■ log det S 



when det 5 > 0. li Xt = t and yU = 0, 5 is the covariance matrix for the Euler-Maruyama type approximation 
{{Y\l))i,{Y^{J))j) of {{Y\l))j,{Y^{J))j) defined by Y\l) = b\L{I)) ■ Wil), Y^{J) = b^{L{J)) ■ W{J). 
Though Hn is the quasi-log-likelihood function for /i = 0, we can see that the effect of drift term /i in a 
quasi-likelihood function can be ignored asymptotically. So Hn is applicable for general cases. 

In the case of synchronous observations, we have uniform non-degeneracy of S by the condition [^1] 2. How- 
ever, in the case of nonsynchronous observations, the problem becomes more complicated since the observation 
times of diffusion coefficients are not the same for Y^ and Y'^ . However, the following proposition ensures that 
Hn is well-defined under [Al] 2. 
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Proposition 1. Assume [Al] 2. Then detS{(7) > almost surely for any a E A. 

Proof. Fix w e fi. It is sufficient to show that S is positive definite. Let {{uj)j, (vj)j) be a real vector satisfying 

{{uj)j,{vj)j)S{{ui)j,{vj)jr ^0. 

We assume that ((m/)/, has a non-zero element and lead to a contradiction. 

Let {W^} and {W^^} be two independent Wiener processes on some probability space, and {Mt}o<t<T is a 
stochastic process on the same probability space, satisfying 



Then {Mt} is a martingale satisfying 

= E|i^/n^*i+Ej|i^'.iVd+2E™6i-6^,^^. 



Since 



(M)t = (K)/, ivj)j)S{{ui)i, {vj)jy = 0, 



it follows that (M)t = for < t < T. 

We may assume some / satisfies L{I) = niin{L(/); u/ 7^ 0} A min{L( J); vj 7^ 0} without loss of generality. 
We fix this / below. 

First, we consider the case that L{I) < min{L(J);wj 7^ 0}. Then 

= \bWujd/\I\ = 

for sufficiently small 5 > 0. Therefore we have — 0, which contradicts [^1] 2. 
In the case that L{I) = L{J) for some J with vj 7^ 0, we obtain 

{M)mns - \bWf^^ + \b'j\'^^S + 2^^^} • b'jS = (3) 

for sufficiently small (5 > 0. Since L{I) = L{J), we obtain 6j = 5|. Therefore 



]bib} 



= 



by ([2]). This contradicts the fact that bjb} is positive definite by [Al] 2. □ 
Let 

b]t-b]t 

Pt= sup \ps\, Pl„J,t = ,,,2' | , Pn{t)= sup |p7,J,t|Vpt, 

To discuss asymptotic behavior of the quasi-likelihood, we need a more precise estimate for non-degeneracy 
of S. To this end, we will estimate 1 — Pn{t) from below. Assuming [Al] and r„ —>p (n -> 00), we have 
supj [pt — Pnit)[ — >■'' (n ^ 00) by uniform continuity of and with respect to t and tr for fixed w. Therefore 
hm„^ (i) > 1] = by @. 

We need a more strong condition for p„. For stochastic processes {s„(t)}o<t<T,neN, we consider the following 
condition: 

[S] There exists M € N, stochastic processes {s„(t, x)} and a cr(n„)-measurable R-'^-valued random variable X 
such that s„(i) = s„(i; X), s„(t, x) is continuous with respect to (t, x) a.s., s„(0, x) < 1 — [po[, 1 1-^ s„(i, x) 
is non-increasing and {sn(i, a^)}o<t<T is the [0, l]-valued J"t-adapted process for n G N and x € R*^. 



5 



Let 

Tn = t(s„) = inf{i G [0, T]-Pn{t) > 1 " A T. 

We consider the following condition for q > and ^ > 0. 

[S-q,^] {s„} satisfies [S], P[r(s„) < T] = 0(5-«) and sup„ £;[(s„(T))-9] < oo. 

Define S = S'((t;s„) and Hn ~ if„((T;s„) similarly to S and i/n respectively, substituting bj ^ for 6} and 

for 6j in the definition of S. Under [S'-g,^], it is easy to see that sup^. |i?„ — as n ^ oo. To 

investigate asymptotic properties of estimators, it is convenient to use Hn- 

If sup( Pnit) < c almost surely for some < c < f , wc can set s„ = 1 — c. However, in general, we need the 
following conditions to obtain {s„} for q > and 5 G (0, 1). 

[A2] Tn as 71 OO. 

[A2-q,5] i?K] = 0(6-*'). 
The following lemma gives examples of {sn} in general cases. 

Lemma 1. Let P > l,q' > Q, Q < 5 < I and Sn{t) = (1 - Pt)lP- Assume [Al], [A2-q',5]. Then [S-q,S] holds 
for any q > Q and < ^ < 5q' . 

Proof. It is clear that {s„} are continuous [0, l]-valucd J^t-adapted processes and the mapping 1 1— >■ s„(i) is non- 
increasing for n G N. Since 1/(1 - \pt\) < 2|6jp|5^p/e for any g > by (P), wc obtain sup„ £'[(s„(T))"'^] < oo 
by [Al]. 

Moreover, let 77 = (<? — £,/q')/9 and qo > £,/rj, then by [^1] and the mean value theorem, we obtain 



sup 

0<t<T 



Pnit) - pt < C supi^ + \Xt\f X sup \Xt-Xs 

t \t~s\<r„ 



For t G (0,r), we have 

1 - Pn{t) < Sn{t) 

From this relation, we see that 



1 - Pnjt) ^1^1 1 ^ Pnjt) - Pt 

I-Pt - P P - I-Pt 

1-Pt<b~'> or b;:>ii-i/P)<ipnit)-pt). 



P[t„, <T] = F[Tliere exists t G [0,r) s.t. 1 - p„(t) < s„(t)] 

< b-'^'^^Eil/il - prr] + P[b7/'{1 - l/P) < by}/'] 



-P 



C sup(l + \X,\f V sup ,^3' > bl 



Then by [^1], \A2-q' ^S] and Kolmogorov criterion ([30] Chapter I, Theorem (2.1)), we obtain 
P[t„<T] < E[{bl^{l-l/P)-\l/y^'] + 0{b-^) = 0{b-^). 



□ 



From now on, we fix {s„} which satisfy [S-g,^] for some q> and ^ > unless otherwise indicated. 
Next, we expand Hn- We denote 

D = diag({|6Lj},,{|65,,J}^), L=(p,.^,,„l^l , 



L 
L* 



Y\J) 
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Since 5* = + L)D, 

Hn = -iz*i\fZ-logdctD + ilogdetM 



for M = (£/„+,„„ + L)-^. Moreover, for G = {\I r^ J\/ y/\I\\T\}ij, we obtain 

II L ir=ll {pi,.Lr..Gij}ij IP V II {pi,j,r^Gij}ji f< (1 - s„(r))2(|| G 1^ V || G* IP). 

Lemma 2. For any n G N bkc? deterministic partitions {/}, {J} o/ [0,T], all the eigenvalues of the symmetric 
matrices GG*,G*G are in [0, 1]. In particular, || G || V || G* \\< 1. 

Proof. We denote by {XiY^i eigenvalues of GG*. Obviously, < Xi {I < i < I). Let be a one- 

dimensional standard Wiener process and 

' £i„ G \ ^^^f -G 

G* £m„ / ' \ £m„ 



then El is the covariance matrix of {{W{I)/ ^/\I\)I , ((M^(^)/v |./|),/) and 

V I ~ GG* 

Since Si is non-negative definite, — GG* is also non-negative definite, and hence 1 — > (1 < i < Z). 
Therefore we conclude i) < \ < 1 [1 < i < 1). 

In particular, we have || G 1P = 1| G*G ||= supj < 1. The same conclusion can be drawn for G*G and 
II G* \\. □ 

Since || L ||< 1 - s„(r) by LcmmaH E^o(~l)^-^'' c^i'^ts almost surely and this gives M = E^o(~l)^-^''' 
under [S-q,^]. Moreover, we obtain 

max |77fe|-||L||<l-s„(T), 

l<k<l+ni 

where {?7fc}|i™ be the eigenvalues of L. Hence 

logdet(£j„+,„„ +L) = Y^ log(l + r,fc) = J] ^ ^ ^ = E ^^tr(i'') 

fc=l /c=l p=l ^ p=l ^ 

almost surely. Therefore 

/ oo \ oo , -p 

^" = --ZM5^(-l)^'ZMz-logdeti? + -^^^ 

\p=0 / p=l P 

p— ^ p— 1 

almost surely. 



3 The limit of and observation times 

In this section, we investigate the asymptotic behavior of _ff„ and -ff„ to apply Ibragimov-Has'minskii's theory. 
To obtain these estimates, we need some convergence conditions ([A3], [A3'] and [Ai'-q^rj] given in Section 3.1) 
for the observation times. Proposition [3] in Section 3.2 will give asymptotic properties of iJ„ and Hn- 
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3.1 Convergence conditions of functions of the observation times 

Since M is a functional of {pi\ji^T„}i,j^ '^6 can write 

Let An be defined as 

A„(C\C2,C3,C4) =tr(Af"(C4)Ci) + 2tr((Afi2(c4))*c3)+tr(M22(c4)c2), 

where €^^€^^0^,0'^ are complex matrices of size /„ x ln,mn x m„,/„ x m„ and /„ x m„, respectively, and the 
absolute value of each element of is less than 1. Then wc sec Z*MZ can be rewritten as 

Z*MZ = An{{ZiZi> } -",, = 1 , {Zj+l^ ^j'+i„ }"/' = ! 7 {ZiZj+i^ }j J , {piij, ). 

Let 1 denote an In x to„ matrix with all elements equal 1, {t'^'*}nGN,p6Z+,i=i,2 be random measures on [0,T) 
which satisfy 

I J 

and 

£^[t) = {<^i,j'l{/'n[o,t)#0}}j"i'=i: '^^(0 = {^j,j'l{JJn[o,t)#0} 
where (5 denotes the Kroncckcr delta function. Moreover, for p e Z_|- and i 1,2, let 

= ^^''^''{f,9)= r f{s)K^ds)~ r f{s)g{s)ds, 
Jo Jo 

for M- valued functions /, g on [0,T] such that / is cadlag and g is Lebesgue integrable. Note that ^(t), 0, 0, zl) = 

ET=o^''<^'i[o^t))^K'An{o,£\t),o,zi) = E;Lo^''<'H[o,t)),^'^^^ 

and ^°''^mo.t),9) = fo-i Ej l{L(J)G[o,t)} " /o for z € C, |2| < 1 and t e (0,T]. 

To obtain convergence of 77„, we consider the following condition. 

[^3] There exist (T({n„}„)-mcasurable left-continuous processes aoit) and co{t) such that a^{t)dt\/ CQ{t)dt < 
oo almost surely and 

^"'\l[o,t),ao)W'^"'\l[o,t),co)^''0 as n ^ oo (5) 
for any t G (0,r]. Moreover, at least one of the following conditions holds true. 

1. There exist 77 e (0,1) and a (T({n„}„)-measurable left-continuous process a{z,t) such that a is 
continuous with respect to z, a(z, t)dt < 00 and b^^An{S'^{t), 0, 0, zl) -^^ a{z, s)ds as n — > 00 
for z e C, |z| < ?7 and t e (0,T]. 

2. There exist 77 € (0,1) and a cr({n„}„)-measurable left-continuous process c{z,t) such that c is con- 
tinuous with respect to z, c{z,t)dt < 00 and 6~^^„(0, f ^(t), 0, zl) — c(z,s)(is as n — >■ 00 for 
z G C, |z| < ?7 and t G (0,r]. 

In particular, {ln/bn}n and {mn/bn}n are tight under ([5|). 

An{£^{T),0,0, zl) and A„(0, ^^(T), 0, zl) appear in an asymptotically equivalent representation of iJ„ 
when 6(.t,(t) does not depend on x and /it = 0. Therefore convergence condition for observation times like [AS] 
1 and 2 are natural conditions to specify the limit of iJ„. 

[A3'] There exist fT({n„}„)-measurable left-continuous processes ao(t) and co{t) such that ao{t)dt\/ co{t)dt < 
00 almost surely and ^ holds for any t G (0,T]. Moreover, at least one of the following conditions holds 
true. 

1. For any p G N, there exists a cr({n„}„)-measurable left-continuous process ap{t) such that ap(t)dt < 
00 a.s. and for any t G (0,r], vI/p^1(1jq a^) — as n — >■ 00. 
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2. For any p S N, there exists a o'({n„}„)-nieasurable left-continuous process Cp{t) such that Cp{t)dt < 
oo a.s. and for any t g (0,r], ^'^'^(Ijo.f), Cp) — as n oo. 

As we will show later in Proposition [21 [A3] and [A3'] are equivalent under [A2]. 

Let g > 2 and rj £ (0, 1). For a G (0, 1/2) and / : [0,T] — >• M, a— Holder continuous, we denote uja{f) = 
sup,^^[ft-fs[/[t-s[-. 

[A3'-q,ri] There exist no £ N, q G (0,1/2 — l/q) and CT({n„}„)-measurable left-continuous processes {ao{t)}, 
{co(t)}, {ap(t)}peN such that /q^(co V ap){t)dt G i«(r2) for p G Z+, £;[(Z„ -I- to„)'?] < oo for n G N and 

sup E[ibl[^^'\f,aoW]yE[ibl[^'''^f,com < C fsup 1/*^ + c.„(/)^) , 

n>na \ t J 

maxsup sup £;[(6:'J^'^''^(/,ap)|)']/(l+p)^ < C fsup + 

for any a- Holder continuous function / on [0,r]. 

For g > 2 and r\ G (0, 1), it can be shown that [A3'-q^r\\ implies [A3']. 
The following lemma is easy to check. 

Lemma 3. Let {opIpgN C C with l^^pl < ^ "^'^'^ {Cp}n,peN I'^c^ {-PnjneN &e random variables satisfying 

(n ^ oo) /or p G N, {i^„}„eN are tight, and [^^[ < F„, {n,p G N). Then J^^^i <Xp^p as oo. 

The equivalence of [A3] 1 and [A3] 2 is established by our next lemma. 

Lemma 4. Assume [A2] and that there exist stochastic processes ao{t) and Co(t) such that aQ{t)dt V 

Co{t)dt < oo a.s. and © holds for t G (0,r]. Then vP'^{[Q,t)) - vl^'^{[Q,t)) -^p for t e [0,T],p > 1 
as n ^ oo and ^ 

b-^An{£\t),0,0,zl)-b-^A„{0,£^it),0,zl)^P [ {ao-co){s)ds 

Jo 

as n ^ oo for z G C, |z| < 1 and t G [0, T] . 

In particular, [A3] 1 [A3] 2, [A3'] 1 ■4=> [A3'] 2 and Op = Cp dt x P-a.e. {t,uj) for p > 1 under the 
assumptions above. 

Proof Since || G || V || G* ||< 1 by LemmaEl we have ]{{GG*)p)ip | < 1, |G/,/| < 1 for any /, /', J and p G Z+. 
Then since G/j ^ implies I J ^, we obtain 



]uP-\[0,t))-:.f-'{[0,t))] = b-' 



7;L(/)e[0,t) /' J 



- E EE^*^/((^G*)'"')"'^^^^ 

j;L{j)e[o,t) I r 

t-rr^<L{I)<t+r,i 

as n — > OO for p > 1 by [A2] . 

Since ]i'P'' {[0 , t)) — v^-^ {[0 , t))] < + m,i), the desired conclusions are given by tightness of {b-'{ln + 

TO„)}„ and Lemma [21 □ 

Proposition 2. [A3] and[A3'] are equivalent under [A2]. Moreover, under [A2] and [A3], a{p,t) — J2'^o'^p(^)p^^ ' 
c{P^t) = Y.7=oCp{t)p'^P and 

b-'Ar,{x^E\t),y^E\t),xyp,E\t)G,pl)^P f A{x,y, p, p,, s)ds 

Jo 

as n ^ oo for x, j/ G R, p, p* G (—1, 1), ^ G (0, T], where 

A{x,y,P,P*,t) = x'^a{p,t) + y^c{p,t) - 2xy{a{p,t) - ao(i))p*/pl{p/o}- 
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The convergent sequence which appears in Proposition [2] is asymptotically equivalent representation of 
h~^Z*MZ if /xt = and h{x,a) does not depend on x. Therefore, the convergence result in Proposition [2] is the 
convergence result of b~^Z*MZ with ignoring the structure of diffusion coefficients {b\,b1). 



3.2 The limit of 

We discuss asymptotic behavior of ff„ under [A3], [A?,'-q,ri]. 

First, we assume one more condition. Let I be a set of intervals defined by 

I = {r]\-^, U {J=Y^-, U {[7^-\ 7?"); 1 < < n2, 1 < J < ml). 

Let 00. fc = for 1 < fc < ^n, ^'o,/c = j'^^'" for ^„ < fc < Z„ + m„, and 

Op.k = u{i^2p; ifi, • ■ ■ , i^2p e A'l n ^o.^ ^ 0, n ^ (i < j < 2p)} 

for p e N and 1 < < Z„ + ?7i„. Moreover, let $p,i = Y.k I^P.feT; ^pi,P2 = Efci,fc2 ^ ^P2M I foi" ^ ^ 2} 

and p,pi,p2 S For q > 2 and 5 > 1, wc consider the following conditions. 

[AA] There exist (5' > 1 such that 



p=0 " / y V P1,P2=0 



as n — >■ cx). 
[A4-g,,5] 
1. 

2. 



lim i? 



^^-f w gxy- (^2p+2,l) 

p=0 ^-^ ^ 



lim E 

n—yoo 



2pi+3,2p2+3 



' (pi + l)'5(p2 + l)*' 

Pl,P2=0 



We can see that [A4-(7, 5] implies [AA\ for any q>2 and (5 > 1 by Jensen's inequality. Moreover, we can use the 
following condition instead of [AA\. 

[AA'] There exist positive constants (5i,(52,<53 such that (3(5i + 25^) V {5i + < 1 and the following two 
conditions hold: 



1. lim. 
2. 



■n— )-oo 1 ' n 



0. 



lim 



sup 

ji,j2eN,\ji-j2\>bi^ 



P 



I Qj2 cji I 

In > Ji V .72 and ^ ^ < 6-1-*^' 



lim 6? 



sup 



p 



TTin > ji V j2 and 



\J2 - Jl I 

\Ti-- - T^'i I 

b2 - jil 



0, 



< b: 



-1-S3 



jij2eN,|ji-j2|>6°2 

Lemma 5. Assume [A4'] and that {{l„ + mn)/bn}neN is tight. Then [AA\ holds. 

Proof. Let e > 0. Then there exists a positive constant K such that P[(/„ + mn)/bn > K] < e for any n e N by 
tightness of {{In + m„)/6„}„. 

Let 0(fc) denote minimal k' > /„ which satisfy l'' D 7^ for 1 < fc < 



U. 



> Jl V j2 and ^— < b-^-^' 

b2 - Jil 



n V"" > V j2 and ^ ^ < b-'-^' 



\.]2-Jl\ 



10 



for Ji , .72 G N and 

Un = {r„ < 6„ + 1} n n^-i J,eN,|J2-Jl|>C"'Jl.J2■ 
TheIl on Z^„, for ki < In, In < ^2 < hi+fnu and pi,p2 G 2^+ which satisfy — fc2| > and 9p-^^ki '^Qp^M 7^ 0j 
we have 

|0(fci) - fe|6-i-^-^ < |r^(^^) - T'^^l < (2pi + 2p2 + 2)r„ < (2pi + 2p2 + 2)b-'+'\ 

Therefore |</.(/ci) - k2\b-^'-^' < 2{pi + l){p2 + 1). 

Then by using the relation \9p^^ki H 6'p2,fc2l — + 1) A (4]32 + !)}'"«, we obtain 



E E 

Pl :P2=0 fei </„,/C2>i, 



(pi + l)5(p2 + l)^ 



< 



^E { E E 



{{4pi + 1) A {4p2 + l)}b, 



-l+<5i 



b"Jb. 



< (7/„?,-l + (3<5i+253)V(5i+52) 



(pi + l)3(p2 + l)3|0(fcl)-fc2P6^25,-253 « " 
1 



|</'(A:i)-fc2P 



1 



on Un ■ Similar arguements for other combinations of fci and k2 yield 



E 



2pi+3,2p2+3 



Pl,P2=0 

On the other hand, since 

Pm]<P[rn>b-'+'^]+P[{ln + mn)/bn>K]+ ^ ^[(";;j2n' 

i<iij2<[ifb„l,b2-ji|>;)^" 
we obtain limsup„_j.oo P[Un] ^ by [AA']. Since e > is arbitrary, we have 

^2pi+3,2p2+3 



E 



Pl :P2— 

It is easier to prove the convergence about $2p+2,i- 
Let B'{x,a) = \b'{x,a,)\/\b'{x,a)\ {i = 1,2), 



(pi + l)5(p2 + 1)5 



0. 



c{p, t) = y ^p^p = y ^^2p^ 



p=l 



P=l 



and 



/i- (a) = - - , i?2 , Pi , pt, „ i ) - ao log I I - CO log 1 6? | 



1 



forte [0,T],pe (-1,1). 

Proposition 3. 1. Let < v < 3. Assume [Al] - [A3]. Then 

i-T 



sup 
o-eA 



b-'d:Hn{a)~ I dlhT{a)dt 
Jo 



>p 



as 71 OO. 



□ 



(6) 



2. Let < w < 3, g G 2N, g > 2 V ni, (5 > 1, ^ > 0, 77 € (0, 1) and {s„}„gN be stochastic processes. Assume 
[Al], [A2], [A3'-q, T]], [A4-{2q),d], [S-{{2v + 2[6] + I2)q),^] for {sn}, and that sup„ Eib-^iiL + m„)'«] < ^- 
Then 



supE 

n 

for 7;'<7;A(l/2)A(e/2<z). 



sup b^ 



b-'d:Hn{a;Sn)- / d:hr{a)dt 



91 



< 00 
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4 Separation of the limit of 

We deal with Condition [H] about separation of the limit of _ff„ which is necessary to apply Ibragimov- 
Has'minskii's theory. In the case of synchronous and equi-space samplings : 5* = T* = [6„]~^iT {0 < i < [bn]), 
Uchida and Yoshida [33] discussed tractable sufficient conditions for Condition [HO] of separation. In this 
section, we will confirm that [HO] implies [H] under certain conditions. 

Under [Al] — [A3], we define 3^Ti(cr;cr*) = h:^^{Hn{<y) — Hn{cr*)), and 3^(cr;tT,) denotes the probability limit 
of >'n(cr;cr*). By Proposition [3l we obtain y{a]a^) ~ J^{h'^{a) — h'^{at))dt. 

Moreover, the equation ^ can be rewritten as 



2 2 pt 

-ao log \bl\ ~ CO log |&?| + r ^dp, 

Jo P 

where A{p) = A{p,t) = a{p,t) — ao(i) = c{p,t) — co{t). Since B},^ ~ Bf ,^ = 1, 

1 1 f*'' A(p) 
h^{a,) - ~-ao- -co-aQ\og\blJ~co\og\blJ+ -^dp. 

2 2 Jo P 

Therefore for yt [a] = h"^ [a) — h'^ (cr* ) , it follows that 

yt{<r) = -l{Bl)\ao+A)-l{B^r(co+A) + BlB^A^ + ^ + '^ 
2 2 Pt 2 2 

+a„ log Bl + Co log Bt + —dp 



Pt.. P 

Pt 



(7) 



= -i(ao + A){Bl - +ao + ao log B^Bf + -dp 

+f^L_>(l _ (^2)2 ^ i^g(52)2) ^ BlB^{Apt^^/pt -A-ao) 

= -kco+A)iBl - 5^)2 + CO + Co log 5^52 + -dp 
2 Jpt., P 

_ (^1)2 + log(si)2) + BlBUApt,./pt -A- Co). (8) 

Let F{x) = l-x + logx (a; > 0). 
Lemma 6. Let t\ £ (0, e^^], £2 > 1. Then 

- log(l/ei)(x - 1)2 < F{x) < ^{x - If/Ael 

for X e [ei, 1 + €2]. 

Proof. For < a; < 1 + 62, since — l/e2 < (a; — l)/e2 < 1, it follows that 

F{x) < -((a; - 1)2 A l)/4 < -(x - l)2/4e^. 

On the other hand, for x > ei, let f{x) — F{x) + log(l/ei)(a; — 1)^ then since f'{x) — [x— 1)(2 log(l/ei) — l/a;), 
we have /(.t) > /(I) A /(ei) > 0. □ 

Let 

/i(i,a;,p,p*) = ao + aologa;+ / A{p')/ p'dp' + x{Ap*/ p - A - qq), 

J P, 

f2{t,x,p,p.^.) = Co + Co log a: + f Aip')/ p'dp' + x{Ap*/ p - A - cq), 

J P, 

and Ci = {\- 4)2/(12i?8). 
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Lemma 7. Assume [Al] — [A3]. Then 

(/i V f2){t,BlBlpuPu.) < -Ci {a,{t)ipt - pu.f + (ao A c^){t){BlB^, - if] 

for dt X P-a.e. {t,u) e [0,T] x n. 

We write J^o for y defined by using the same processes X, Y and synchronous equi-spaced samplings S' ~ 
= T^: = [b,,]-HT (0 < i < [6„], 1 < fc < 712). Let 

X cr*)= mf Xo(cr*) = mf —. 

Moreover, we consider the following conditions. 

[H] For every L > 0, there exists cl > such that for all r > 0, P[x < J"^^] < cl/t^. 

[HQ] For every L > 0, there exists > such that for all r > 0, P[xo < ''~^] < cl/^^ ■ 

[H'] X > almost surely. 
Obviously, [H] implies [H']. 

Lemma 8. Assume [A\]. Then there exists a positive random variable TV which does not depend on cr, cr*, such 
that E[{TZ'Y] < oo for any q > and 



3^0 C 



> -n' r {{Bl Bff + {BlB^, If + {pt Pm)'} dt 
Jo 



for any cr, cr* G A. 



The following proposition ensures that to prove [H], it is enough to prove [HO] which is the condition of 
separation for synchronous and equi-spaced observations. 

Proposition 4. Assume [Al] — [A3]. Then there exist positive random variables TZ which do not depend on 
a,af: such that E[TZ^''] < oo for any q >l and 

y{a;a,)<-n f {{aoAco){{Bl-Bff + {BlB^^lf} + ai{pt^pt,.f}dt 
Jo 

for (7, (7* G A. In particular, if E [{ess i'D£f.^[Q x]0.i(t))^ '^] < oo for any q> 0, [HO] implies [H]. 

Proof. In the equation ([5]), by using the second representation if ao < cq and using the third representation if 
ao > Co, we obtain 

ytM < -^(ao A CO + A){Bl - Blf + (A V /2)(i, BlB^pu p*,,). 

By Lemma [3 we have 

yt{<j) < -^(ao A co){Bl - Bff - CiaiU - pt,.f - Ci(ao A coKB^Bf ~ if 
for dt X P-a.e. {t,uj), where Ci = (1 — p'^f / {12R^). Therefore by integrating with respect to t, 

y{<7;a,)<-n [ {{aoAco){{Bl~Bff + {BlBf-lf} + ai{pt-pt,*f)dt, 
Jo 

where TZ = Ci. In particular, let i?[(essinfjg[o,T]ai(i))^''] < oo for any g > and [HO] hold. We can see 
ao A Co > ai for dt x P-a.e. (t,w) since ^^''([0,1)) < i^°''([0,t)) for any t £ (0,T] and i ^ 1,2. Therefore by 
Lemma |5] we have 

y{a; a,) < -7^css inftai(0 / {{Bl - Bff + {BIB^ - if + {pt - pt,.f) dt 

Jo 

< TZ{TZ'y^essinitai{t)yo{a;a^) 
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almost surely, where TV is defined in Lenima|Sl Hence x ^ TZ{TZ') '^essinftai(t)xo a-S. and for any i > 0, there 
exists a constant cl > such that 



< ^^ + 1-E 



P[X < r^^] < P[xa < r'^^^] + P[7^(7^')"^essinftal(^) < r-^/^j 

(7e'7e"^(cssinftai(t))-i) 

where C2l,o denotes the coefficient of r^^^ in [HO]. This gives [H]. □ 
Remark 1. In the case of nonsynchronous observation, under [Al] and [A3\, we can prove an inequality 

y{<j;a,)>-n' I {{aoVco){{Bl-Bff + {BlB^-lf} + ai{pt~pt,.f)dt, 



which corresponds to Lemma\^ 

Remark 2. By Proposition^ it follows that 

yo{a; (7.) < -7^ / {{Bl - Bff + {BIB^ - if + {pt - pt,*f}dt. 
Jo 

On the other hand, we can see that there exists a positive random variable TZ such that E[R,'^] < oo for any 
q > and 

\{bbnt - {bb-^k.i' < niBi - Bif + {BiBi - If + {pt pt^.f} 

for any t G [0,r],cr, cr* E K by using the inequality [x — \ f + (j/ — if < {x — yf + 2{xy — if {x,y > 0). 
Therefore [HO] holds if there exists a constant e > such that 

[{bb*){x,<Ji) ~ {bb''){x,a2)[ > e[ai - a2[ 

for any x G R"^,(7i,(T2 G A. Weaker sufficient conditions for [HO] can be found in Uchida and Yoshida JS, 



5 Asymptotic properties of the quasi-maximum-likelihood estima- 
tor and the Bayes type estimator 

In this section, we investigate consistency and asymptotic mixed normality of the quasi-maximum-likelihood 
estimator and the Bayes type estimator as main results. 

Let the quasi-maximum likelihood estimator (7„ of the parameter cr he a £ A which maximize _ff„. If 
maximizing points arc not unique, we select so that (t„ is measurable. 

Theorem 1. Assume [Al] — [A3], [H']. Then — >^ cr* as n oo. 

Proof. By Proposition [31 we have sup^. |3^n(o') — y{<^)\ as n — >■ oo. On the other hand, by [H'], for any 
e, (5 > 0, there exists 77 > such that P[x < ^7] < £• Since yn{o'n) > 0, it follows that 

P[\(Tn -<j4>d]<P[x< v] + P[yiO < -V^^] < e + ^'[sup [ynia) - yic7)[ > 

a 

Therefore there exists uq E N such that P[|o-„ — (t*| > S] < 2e if n > uq. □ 
Let {s„}„gN be stochastic processes which satisfy [S], 

r = - / dlh^ia,)dt, 

Jo 

Unia,) ^{ue W'^;a, + bn^^\ G A}, Vn{r,a,) = {[u[ > r}nC/„(cr*), andZ„(u,cr,) = exp(H„(CT*+6,T^/\; s„)- 

HnicF*;Sn)) for U £ Un{cr). 
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Proposition 5. (polynomial type large deviation inequalities) Let L > and S S (0,1/2). Assume for any 
q>0 there exists q' e 2N,q' > q and S' > 1 such that [Al], [A2], [A3'-q',S], [AA-q',S'], [H] and [S-q',2q'S] hold 
for {sn}- Then there exists Cl > such that 



sup Zn{u, (7*) > e ''/^ 
tteV„(r,(T,) 



for any 7i G N and r > 0. 



Let Af be an ni -dimensional standard normal random variable which is defined on an extension of (f2, J-', P) 
and independent of F . We use the same notation E for expectations on the extension of (fi, P). 

Theorem 2. 1. Assume [Al] - [AA], [H']. Then bll'^{an - cr*) ^'"^ V-^/'^M asn-^oo. 

2. Let 6 e (0, 1/2). Assume for any q > 0, there exists q' G 2N,q' > q and S' > 1 such that [Al], [A2-q',S], 
[A3'-q\6], [A4-q',5'], [H] hold. Then E[Y' f{bl/^{&n - cr*))] ^ E[Y' f{r-^/^Af)] as n ^ oo for any 
continuous function f of at most polynomial growth and any bounded random variable Y' on {D,,F). 

We also consider the Bayes type estimator ct„ for a prior density tt : A — R+ defined as 

exp(iJ„(cr))7r(cr)c?(T ) / a exp{Hn{a))'K{a)da. (9) 



Theorem 3. Let 6 £ (0,1/2). Assume for any q > there exists q' G 2N,q' > q and 6' > 1 such 
that [Al], [A2-q',S], [AS'-q' ,6], [AA-q' ,6'], [H] hold, and that the prior density tt is continuous and < 
ml^TT{a) < sup„7r(<T) < oo. Then bl/^{an — cr,) ^^--^ T^^^'^M as n ^ oo. Moreover, E[Y' f{bl/^ {(t„ — cr,))] ^• 
E[Y' f(T~^/'^N')] as n ^ oo for any continuous function f of at most polynomial growth and any bounded 
random variable Y' on {VL,F). 



6 Sufficient conditions for the conditions about the observation times 

In this section, we will introduce tractable sufficient conditions for [A2-q, S], [A'i'-q, rj], [AA-q, S], and the estimate 
with respect to essinftai in Proposition 21 

Let q > Q. We consider the following conditions for point processes {A^^ }o<t<T,i<i<n2+2 which generate 
observations. 

[Bl-q\ There exists no G N such that 



sup max sup E 



[B2-q] There exists no G N such that 



limsup sup max sup w'^P[A^* _i — = 0] < oo. 

u—ioo ii>rio 1 — ' — "2+2 Q^j^ji^^jj-l " 

For example, let X = Y, {&„} is a positive integer valued sequence, {N^}, {N^} be two independent ho- 
mogeneous Poisson processes with positive intensities Ai, X2 respectively, and stochastic processes {N^}, {N^} 
satisfy Nl = Nl ^, {i = 1,2). Then [Bl-q] obviously holds for any q > 0. Moreover, [i32-(7] holds for any q > 
since 

lim u'' sup sup sup P[Ni^ ~ Nl = 0] = lim u'^e"^^^''^^^'' = 0. 

We will investigate sufficient conditions of [A?,'-q,rj]. First, we denote tk — rfc/[fe„] (0 < fc < [6„]), = 
a{Nl - Nl;tj < s <t <tk,i = 1,2) {Q < j < k < [fo„]), ajf = 1/4 and 

al = Qy sup sup sup [P{Af^B)- P{A)P{B)[ (10) 

1 <ji ,h < [f-n] - 1 j2 -ji > k AeGSj^ see]; _ J 
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for keN. 

Let Cn* be measures which satisfy Cn*([s,i)) = -E[j^^'*([s, t))]. Moreover, for no e N, e' > 0, a Lebesgue 
integrable function g : [0,T] i— >■ M, and a continuous function / : [0,T] i— >■ M, we define 



*no.e'(/;.9)= sup 6^ 

n>no 



/tCr(di)- / ftgtdt 

Jo 



Proposition 6. Let q e 2E, q > 2, e e (0,1), S > and /S e (0,1/2 - l/q). Assume that [Bl-{q{l + S))], 
[B2-{qe)] hold, E[{N^ + iV|,)«] < oo for n£N and there exists uq eN such that 

oo 

S = sup ^(fc + l)'?-2+('/-i)/«a^ < oo. (11) 

n>no 

Moreover, assume that there exist e' > 0, C > 0, and left- continuous deterministic functions ao{t), Co(t), ap{t) {p G 
N) such that ap{t)dt < oo (p £ ^+), Jq coit)dt < oo anrf 



<o,.'(/;«o) V <;^,,,(/;co) V max sup "'V^c ^ C(sup |/*| + o.;3(/)) (12) 

/or any /3-Hdlder continuous function f : [0, T] — > R. Then [A3'-q, 77] /loZds /or 77 = e' A /3 A ((Se/(2(1 + (5 — (5e))) 
wzt/i a in [A^'-q,r]] equals p. 

For example, let {Nl}t>o be a point process where the distribution of {Nl_^^^ — .^t+t^_j)fcLi does not depend 
on t > for i = 1, 2, A/ G N and < to < < ■ • • < tn- Moreover, let {Nl}t satisfy = iVj^^j^ for t G [0, T], 
« = 1,2 and G N. Then the relation holds if [-Bl-(2)] and [B2-e] hold for some e G (0,2]. In this case, 
we obtain Op = T'^ lim„^oo E[vP'^{[0,T))], cq = T^^ lim„^oo E[iy^'^{[0,T))], and e' = (e/4) A /3. In particular, 
{ap}pgz+,co are constants. 

For general {NJ:}, the following propositions are sufficient conditions for [A4:-q,6], [A2-q,6] and the estimate 
of essinftai(t) in Proposition 2] 

Proposition 7. Let qe2N, q>2, p[,p^2 > 1^ l/K + IM = 1- Assume [Bl-{p[q)] and [B2-{p'^{q + 2))]. 

L Then there exists no G N such that sup„>„j^ i?[($p)''] < C{p + l)"^^^ for any p G In particular, 

[A4-q', (1 + 3/q')] I holds for any q' G [2, q). ' 

2. Then there exists no G N such that 

sup E[{%,^pSn < C{p, + lf-+\p2 + 1)*+' 

n>no 

forpi,p2 G /n particular, 3] 2 holds. 

Proposition 8. Let q £ N and we assume [B2-{q+l)] . Then there exists no G N such that sup„>„^ E < 
00. 

Proposition 9. Assume there exists ni G N and q > such that [A3'] and [B2-q] hold, ai(t) does not depend 
on t, j-iji — -^/}o<t<T-[6„]-iT.n>ni, 1=1.2 tight and a-mixing coefficients {a]^}k defined by p0[l satisfy 

sup„>„^ X]fe°=i ^0!fc Then there exists a constant S > such that ai > S almost surely. 

Finally, we state a corollary of main theorems. 

We assume {NJ:}t>o is a exponential a-mixing point process where E[{Nl + ^1 )'] < 00 for (7 > and the 
distribution of (TV^.^^^ -^j^tfc^Jfcii does not depend on t > for i = 1, 2, M G N and < to < ti <■■■< tM for 
1 < i < 2. Let {NI} satisfy N'l = N^f^ for t G [0, T], j = 1, 2 and n G N, (T„ be the quasi-maximum-likelihood 
estimator defined by iJ„, tt : A — > be a continuous function and (T„ be defined by 

Corollary 1. Assume [Al], [HO], [Bl-q], [B2-q] for any q> 2. 
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1. Then o-„ a^, bi^'^{an-a,) ^""^ T-^/^Af and E[Y' f{bl/'^{an-<y*))] ^ E[Y' f{T~^/'^Af)] 



1/2, 



oo for 



any continuous function f of at most polynomial growth and any bounded random variable Y' on (57,7^). 

2. AssumeO < inf., 7r(cr) < sup^7r(cr) < oo. Thendn a^, bH"^ {dn-o*) ^""^ T~^/'^Af and E[Y' fibH"^ {d^- 
(7*))] — > E\Y' f{r~^/'^J\f)\ as n ^ oo for any continuous function f of at most polynomial growth and any 
bounded random variable Y' on (fi, J"). 

Example 1. We consider a simple model with deterministic diffusion coefficients: 



cjidW} 

a^dWl + 0-2 dWt^ 
(0,0) 



where e > 0, R' > e and a = (cri, (72, ca) G A = (e, R') x (e, R') x (— i?', R'). Let {N^}, {Nf} be two independent 
homogeneous Poisson processes with positive intensities Ai , A2 respectively and point processes {N^}, {N^} which 



generate observations satisfy 



1,2) 



Then we can easily check [A\\, [B\-q\, [B2-q\ hold for any q > 2. Since {x + y)^ > — y^ for .t, y € M, 



have 



\bb*(a)^bb*{a)\'' 



> 



-2\2 



> 4e^((Ti - (Ti 



for (T, cr G A. Then by Remark[ 
Hn can be written as 



{R'f 



16(i?') 



obtain [HO] . 



2 



i6{R'y 



2\2 



> 



8(i?')^ 



Y\P)Y fY^Ji)Y 



Y\r] 



Y%P)_ 



J 



- log dct 
2 ^ 



i?y calculating a which maximize Hn, we obtain the quasi-maximum likelihood estimator a n = (o'i,n, o'2,ti, o'3,n). 
By CorollaryUl we have (t„ — ct,, ^Jnipn — c*) iV(0, F^^) as ?i — > 00, where cr* = (cri,*, 0-2,*, 0-3^*) is the 

true value. In this case, p — ptic*) can be written as p = a-^^^j \J <^2 * + o's {^pl^O' {^pl^o 1^3'] become 
constants and a, c in [A3] can be written as a{p') — oq = c(p') — cq = .4(p') = X^j^i ^ ifi'Y^ p' •= l)■ 
//p 7^ 0, r and can be calculated by using Provosition \l(A later as 



/ ao+g 





V 



2cp'(l~p')-d,Ap{l-p'Y 



0"l,.cr3,, 
2cp^(l-p^)-a,^p(l-p^)^ 
f 2,* "^a,* 

-^+2cp*+ap^p(i-p^)^ 



r 



Tl^acA + 2dpAp{aoc + coa)} 



diag({cri,*, 0-2,*, o'3,*})^diag({cri,*, 0-2,*, fTa,*}), 



( -2cA+{c„+c)dpAp A{~^ + dpAp} 
A{-^ + d,Ap} 



\ A{2c + dpAp) 
and p' ~ p is substituted for a,c,A,dpA. 



-2aA+{ao+a){2cp-^+dpAp(,l-p^y} 

iao + a){-^+dpAp} 



A{2c + dpAp) \ 

(ao + «){-r^+ap^p} 
(ao + a)(2c + apylp) j 
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Table 1: Sample means of estimators for 10, 000 independent simulated sample path. T = 1, (Ai, A2) = (1, 1). 
The left table represents the result for {(Ji, a2, (J3) = (1,1,0.5) and the right table represents the result for 



(ci, cr2, (73) = (0.5,2,1). Sample standard deviation are given in parentheses. 



n 




50 


100 


500 


n 




50 


100 


500 




true value 










true value 








0"l,n 


1 


0.994 


0.998 


0.999 


0"l,n 


0.5 


0.497 


0.499 


0.499 






(0.102) 


(0.070) 


(0.031) 




(0.050) 


(0.035) 


(0.015) 


0"2,n 


1 


0.968 


0.983 


0.996 


0"2,n 


2 


1.936 


1.968 


1.995 






(0.129) 


(0.091) 


(0.040) 






(0.259) 


(0.181) 


(0.079) 


'5"3,n 


0.5 


0.499 


0.502 


0.5 




1 


0.986 


0.996 


0.997 






(0.224) 


(0.154) 


(0.067) 






(0.449) 


(0.307) 


(0.135) 


0"l,nO'3,„T 


0.5 


0.5 


0.503 


0.5 




0.5 


0.495 


0.499 


0.498 




(0.238) 


(0.165) 


(0.071) 




(0.239) 


(0.164) 


(0.072) 


HY„ 


0.5 


0.501 


0.504 


0.5 


HY„ 


0.5 


0.498 


0.499 


0.498 






(0.336) 


(0.236) 


(0.106) 






(0.335) 


(0.237) 


(0.108) 


y/v/n 




0.228 


0.161 


0.072 






0.228 


0.161 


0.072 


^vo/n 




0.339 


0.239 


0.107 






0.339 


0.239 


0.107 



We can see the estimator (Ti^„(73.„T for the cross variation {Y^,Y^)t = o'l^^i.cra^^T' also has consistency and 

V^(<Ti,„a3,„r - {Y\Y^)t) iV(0, v) 
as n ^ (X) by using the delta method, where 



V = Ta^ a. 



2 „2 2a(/3)c(p) + dpA{p)p{a{p) + c{p)) 

2a{p)c{p)A{p) + dpA{p)p{aoc{p) + coa(p)) ' 



By using the result in Hayashi and Yoshida fJ^j/ . we can calculate the asymptotic variance of estimation 
error of the Hayashi- Yoshida estimator HY„ . In the settings in this example, we obtain 

V^(HY„ - {Y\Y^)t) N{0, vo) 

as n ^ 00, where 

We also simulate (T„, (Ti,„(73_„T, HY„ for some values of parameters. Table 1 represents the results. We can 
see that each estimators work well and sample standard deviation of ai^n^^^nT is about two-thirds of that o/HY„. 
The lowest two rows represent numerical calculation results of asymptotic standard deviation of estimators and 
we can find these values are close to sample standard deviation of estimators. 



7 Proofs 

7.1 Proof of Proposition [2] 

Proof of Proposition [2l 

[^3'] ^ [A3]: 

Since i/^'^([0, t)) < b~^ln, {6^^^Ti}neN is tight, ap{s)ds < ao{s)ds and zyP'^([0, t)) converges to ap{s)ds 

in probability by [A3'] for p e Z+, we have X]^o Iq o,p{s)ds < 00 and 

b-'A^{£\t), 0, 0, zl) = ^''''^n '([0, t)) / «f (^)^« 

p=0 p=0 

for any t E (0, T] and z e C, [zj < 1 by Lemma [3l 
[^3] => [A3']: 
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Fix t € (0,T]. Let {fn} be functions on {z G C; \z\ < 1} satisfying 

QO 

U{z) = h-^A^{£\t), 0, 0, zl) = t))- 

Then since t'P'^([0,t)) < h^^^l^ the power series in the right-hand side converges absolutely on {|z| < 1}. 
Consequently, /„ is the holomorphic function. Then we have 



l='?/3 



Uz) 



dz. 



Let f{z) — a{z, s)ds. Since 



\fn{z)\ < 



If, 



1 ^ 9ln 

6„ 1 - (2/3)2 ~ 5&„ 



(13) 



(14) 



on {|z| < 2/3}, {sup|2|<2/3 |/n(2^)|} are tight. Moreover, since fn{z) ,f{z) {n — > oo) for z S C,\z\ < 77, 

sup|^l<,j/2 \ fiz)\ < (9/5) ao{t)dt < 00, almost surely. Therefore {sup|^|<,^y2 ~ /(^)l} are also tight. 

Let r : |z| = 2/3. For any zi, Z2 G {\z\ < 1/2}, the Cauchy integral formula gives 



27r|/„(zi)-/„(z2)| 



/n(0 fniO 



^ - Zl Z2 



fniOjzi - Z2) 
r (e - Zl)(e - Z2) 



< |zi-Z2|-27r---62. sup |/„(z)| < -Z2I 



|z|<2/3 



By the convergence fn{z) — >-P /(z) {n 00) for z G C, |z| < 77, we obtain 

\fizi) - f{z2)\ < C|zi-Z2| / ao(s)ds a.s. 

Jo 

for Zl, Z2 e {z; |z| < 77/2}. Then for any e > 0, tightness of {b~^ln} gives 



lim supP 

n'-^0 n 



sup \[fn~^){z^)-{,f,,-f){z2)\>e 

zi,Z2e{\z\<7]/2},\zi-Z2\<r]' 



= 0. 



Then by the tightness of {sup|^|<^/2 \fn{z)~ f{z)\}n and tightness criterion in C space in Billingsley [7] which can 
be extended to the one in C({|z| < 77/2}), {/„ — /}„ is tight in C({|z| < 77/2}). Therefore, since /„(z) — >p /(z) 
as n — > 00, we see that {/„ — /} converge in probability to in C({|z| < 77/2}). Therefore by ([T^. we have 



f{z) 



dz 



l='?/3 



as 71 — )■ 00 for p > 1 . 

By the equation /(z) ~ a(z, s)ds and Fubini's theorem, there exists ap{s) such that jj" ap{s)ds < 00 and 

K'^i{0,t)) J*ap{s)ds as 71 ^ 00. We thus get [A3']. 

Moreover, under [A2] and [A3], the above proof gives the relations between a, c and {ap},{cp} in the 
statement. The rest of the proof is easy since 

b-^A^{x^£\t),y^£^t),xyp,£\t)G, pi) 

00 

p=0 



□ 
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7.2 Proof of Proposition [3] 

To prove Proposition [31 we use some Lemmas. First, let 

R ~ max max max sup f 6^1 V 

0<^<40<j<3 1<p<2^gA,t,e[0,T] (l<fc<n2) V 

V max sup | fej | V max sup | fej"' | , 

l<»<3tg[o,T] 2<i<3a<i<3 jg[o^X] 

then i? > 1 and E[R'^] < oo for any q> under [Al]. 

Lemma 9. Let q E N, M E NU {oo}, [Q,' ,F' ,P') he a probability space, {Fj}j^-^ be random variables, and Q 
be a sub a -field of J-' . 

1. Then X^jii-^jTI^] — ( -^'[l-^jl^l^] where E' denotes expectation with respect to P' . 

2. We assume q G 2N and {X]^=i Pj}o<k<M is martingale with respect to some filtration. Then there exists 



a constant Cq > which depends only q, such that -^iT] — ^g(X]jf=i ^'Il-^il'^] ' ) ' 



Proof. Wc expand the summation and use Holder's inequality. 

M M M 

E'[\J2F,\'\g] < E'[\F,,...F,J\g]< E'[\F,,\''\g]^...E'[\F,J'^\g]'. 

M 



< 



1 \ 1 



For 2., we use the Burkholder-Dcvis-Gundy inequality and apply 1. for g = {0,ri'}. □ 

Lemma 10. Let {Gpjpgz^ be a sequence of positive numbers, a E N,b,r, s E Z_)- and p E [0,1). Then there 
exists a constant C > which depends only on a, b, r, s such that 

Y + lYG, < C{i ( Y 7^TT^7 

Proof. By the Cauchy-Schwarz inequality, we have 

oo y oo s i y oo ^2 

Yp<^-'^-\p + iyG,<[Yp''^^^-'^^\p + ir+A [Yttw- 

p=0 ^ p=0 ^ ^ p=0 ' 

Then the conclusion follows since 

oo oo N| 

Y p'^^'-'^^'ip + <c+ cYp'^^'ip + ^f'^' <c+ g (,_72J)I.t+i - 



p=0 p=0 



□ 



Lemma 11. Let [Q' ,J-' , P') be probability space and {^rijrieN C J-' be sub a-fields. 

1. Let {X;}„gN C L^{n'). Assume E'[\X'J\gn] (n ^ oo). Then X'^ (n ^ oo). 

2. Let di,d2 E N, p > di. A' C M'*! be a bounded open set and X',^ : Vl' C^{A';R'^^) be random variables 
{n eN). Assume that A' satisfies Sobolev's inequality, {swp^^j^i \X'^{a)\P V \da-X'^{a)\P}nefi ^ L^{Q,') and 
sup^eQ^inA' E'[\d^X^{a)\P V |X;(a)|P|g„] as n ^ oo. Then sup^g^' 1^4(^)1 as n ^ oo. 
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Proof. 1. For any e,(5 > 0, there exists iV G N such that P'[£;'[|X;j|5„] > eS/2] < e/2 for n> N. Therefore, 
for n > N , we have 

P'[\X'J>S] < P'[i?'[|X;||t;„]>eV2] + P'[KI>'5,i?'[|X;||t?„]<6<5/2] 
< ^ + ^E'[\X:,lE'm\g„]<eS/2] 

^ + ^E'[E'[\X'J\g„],E'[\X'J\g^] < e6/2] < e. 



2. First, by Sobolev's inequahty, we have 

p 



E' 



sup \X'^ 



Gn 



< CE' 



\d.Xyda 



Qn 



CE' 



Moreover, for u = 0, 1 and A e Gn, it follows that 



E' 



\d:x'Sda,A 



= / E'[E'WM^\Gn].A]d<J 
J A' 



< 



E' 



sup E'[\d:;x:,\p\Gu],A 

(TeQ''inA' 



da < E' 



sup E'[\d:x'jp\Gn]-\nA 

creQ''inA' 



where |A'| denotes volume of A'. Since A E Gn is arbitrary, we have 



E' 



KKl'da G: 



Therefore we obtain 



E' 



sup ix; 



< 



< sup E'[\d:X'^nGn]-\^'\ a.s. 

o-eO''inA' 



C|A'|^ sup E'[\d:x'S\Gn]^^Q 



as n — > oo. Then the proof is completed by 1. 



□ 



Lemma 12. Let {n',T',P') be a probability space, T' > 0, q e 2N, {J"t}o<t<T' be a filtration, M e N, {K'-}fi^ 
be a deterministic partition o/[0,T'] where L{K^) < L[K^) fori < j. Let (VF/, J^()o<t<T' be standard Brownian 
motions {I = 1,2,3), and Fij,k be •^i^(^x^)AL{Ki)AL{K''}~^^'^^^™^^^ random variables. Assume (W^^ ,WP^) are 

deterministic for 1 < pi < p2 < 3. Then for AW^ = W^{K^), = ^ ^J'-^^J '^"^ ^i-j ^ ^i-J^^' ^^^'^^ 

exists a constant Cq > which depends only on q such that 



E' 



J2 AWlAWfAW^F,,,^k 

i,j,k 



< 



cJY^\K^\\K=\\K^\E'm,,,uni 



i,j,k 



1 = 1 



Proof. In this proof, we set general constants denoted by C depend only on q. 
Let us denote 

= AWlAW^AWlF.,^,^,, -Hi, = H.,,,, + H,,.,, + H,.,,., 



then it follows that 



E H... - E ^"^^ + E T.^. + n^) + E E E ^ 



3 



i j<i k<j 
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Since {W^^ , W^'^) is deterministic for 1 < pi < P2 < 3, Ito's formula yields 
for k < j < i. Therefore by Lemma IHl we have 



E' 



CE' 



L{K')\ 



i j<i 



(15) 



i j<i k<j 

We will estimate each term of the right-hand side of (fT5)) . First, 

E^'[I^M..r]' = E^'[I^M.d'i?'[(AW,iAt^^AW,3).|j-^^^^,j]]f <C^|Xf i?'^ (16) 



Let 



Since 



E' 



E^ 



<CY,E'[iV^;^^E'[H^j\:F',^^,^'^]^+ciY,E'[E'[H^^^^ 

j<i ^ j<i 



for each i, Z by Lemma [21 we obtain 



< cj:\k^\e' e e^ 



11 a 



c j:\KrE' E E^^'^'. 

1=1 ^ j<i ^ i 1=1 ^ j<i 

< cE 1^1 E i^^'f E^'[(^'.)i ' + cE i^'i E (T.\i<'\E'[iFi^r]^ 

i j<i ;=1 i 1=1 ^ j<i 

+cEi^i'Ei^'iE^'[(4.)i'- 



i<i 1=1 



Moreover, let 



3,1 
i,j,k 

3,2 

i,j,k 

3,3 



AWf AW^|^^,j,fc + AWiAWfFi^kj, 
Aiy/Aiy^F,- ,,fe + AW^feiAWf Ffc,,,,, 
AW|AWiF,^k,^ + AWlAWfFk,,,^, 



then by Lemma [H] we have 

E^'[(EE^L-,^-''' 

I '- ^ j<i k<j 



1=1 



(17) 



3 3 

< ^Ei^iE^'i(EE^^i.)T-^^"^'"^^^i(^^-^^ 

^ j<i k<j ' -* i 1=1 j<i '- ^ fc<i ^ 
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< CE|A'lEl^''lEl^^'l(^'[(^^^-''01' 

j j<i k<j 

+E'[iF,,,,kr]l+E'[{F,,,,,y]l+E'[iF,^^^^^^^ 



(18) 
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Furthermore, let gi{K') = {W"^ ,W^)iK'), g2{K') = {W^,W^){K'), g3{K') = {W\W'^){K'), then we obtain 



i j<i 

Hence Lemma [9] yields 



E' 



i j<i l—l 



< 



1=1 



J 1>J 



E' 



EE ^'[^1.1-^ 



L(K-)- 



< c(Y,\K^(Y,\K'\Y,E'[{Fi,rf. 

^ j ^ l>j 1=1 



By (|T5|) - (|T9)) . we obtain the conclusion. 

For p > 0, we denote 



(19) 
□ 



p/2],iUe[p/2] 



i,j+i„)AT„G/i^jj},j, Lp 



Lp 

l; 



p=0 



Mp = 



{GG*y {GG^YG 
{G*G)PG* {G*G)P 



and Df = diag({|6}_^^ |}/n[o,t)#0' {l^j,r„ l}jn[o,t)5^0)- Though {Zk,t}t is not necessarily a local martingale, we 
denote by {Z)t the quadratic variation of Z regarding 11 as deterministic functions, that is, {Z)t be an (Z„ + 
frin) X {In + TUn) Symmetric matrix with 



{k, k' < In) 



Ii^njf^'- bl,*-bl.ds/{\b],^J\b%,„,^Jy^\Fp^\ {k < L,k' > In) 
Moreover we define 

Hi{t) = Hl,S^-a) = -\z*JlZ.^,-\ogdciDt + \Y.t^ 



P 

p=l ^ k 

Hl{t) = ff^,,Jt;a)=-itr(M(Z)0-logdetA + iE^E(^P"l{«o,^^ 



fcn[o,t)#0}' 



2 ^ p 

p=l ^ k 



n[o,t)#0}: 



oo 2 „t 

HUt)=Hl,Jt;a)^bnJ2Y. / A r(s„), s; a)z.P-'(ds), 

p=0 i=l -^0 



Zk = Zk,T, and i/; = H'niT) (l < i < 3), where 

_ KJ 



Ifat.J' 9„ ,l( \blj\bl,\ _ \ 2p-l 



(p = 0) 



-)pf-V*.* + % b>i) 



for i = 1, 2. Then we have daHl ^ {t\ cr,) = on {t(s„) T}. 

Let (? G 2N, 7 G (0,1) be defined in [^1] 5., = supo<t<T 6^ = supo<,<,<T £;[|Ait - Msl^VI*- 

and {s„(t)}o<t<T.nGN be stochastic processes which satisfies [S]. Moreover, we define 'Pq{{xp}) = (X]^o ^ 

(Er=o4'^^''''^)'"'/' for C E+ and q G 2N. 



23 



Lemma 13. Assume [Al]. Let r G N, r > 2. Then there exists a constant C > which depends only on q,r,n2 
and 713 such that 

< c{Ti'i V i){E[R^] + e^)£;[i?^s„(r)-(2«+2'-+^)«|n]5 



f v/(^«+m„)$2p+2.2V$2p+2,l ) ^ , £ 



E 'g2pi+3,2p2+3 \ I 



pi,P2=0 



E[\d:H^^,jT;a)~d:Hi^jT;a)m] 
< CE[R-{l^Pr)-^]\(Y^p^] +( 5: *^..+-P.+^ 



p=0 " ' ' Pl,P2=0 



/or < w < 4 and cr G A. 



Proof. In this proof, we set general constants denoted by C depend only on q,r,n2,n3. 
We first prove Let 

. Jv^) {k<ln) 

for 1 < fc < ^ri + iTT-n- Then -ff„((T; s„) — Hl^ (T; ct) can be decomposed as 

H^{a; s„) - Hl^jT; a) = -\z-{M - A/)Z - /i*M(Z + f ) + ^ £ " tr(iP)). 

p=i ^ 

We will estimate each term of the right-hand side of this equation. 

First, we assume that 11 is deterministic. Let Wt = (Wt, Wt), then we can write 

by Ito's formula, where 

\dX:t'\ < 2 • 2 . 4^+\2p+ir+' ■ n2R^"+Hl - s„(r))(2f— i)vO(Mp)^,^„l^^^^^ j^)^ 

Moreover, let l^'j'^ be the one constructed by (^^'^ substituting L{92p+2.k) A t(s„) for all times of X, 6^ and 
h^, then we can write l^'f = fp'^rl^l*) some random variables {Cp'^jif , where {K} denotes the set of 
intervals obtained by unifying partitions {S'*},{T^} and {7^?}. Furthermore, let 

Ct' - = f 4":"' ■ + f fipis'ds, (21) 



then we have 

|5^4^;f I < 2.4. 4''+i(2p+ . 4(2p + 2) . nlR'^+^{l ~ s^iT))'^^^-^-^^''^ {A\)u^u'le,^,U^), 

|5^,7p.f I < 2.8.4''+i(2p+ir+i . i42(2p + 2)2 .n^i?2"+9(i_5„(r))(2J'--3)v0(M^)^_^,l,,^^,,,(5). 
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Therefore we can write 



iz*(Af - M)Z = E E ( / 4'' ■dm+ f Vp'fdt) Z,Z,, 

^ OO p ^ OO p 

= E E / 4':"' ■ dw,z,,,z,,,, - ^ E E / (4'' - 4":"') ■ dw,z,z,, 

~ 2 E E / 4,^ ■ dWt iZkZk' - Zk,pZk',p) - 2 E E / dtZkZk' 



p=0 k,k' 



P=0 fc,fc' 



where 



Let k^{K) denotes k < In which satisfies K C l'', k'^{K) denotes k > In which satisfies K C J'^ and 



Bk,p — <^ 

Then X can be rewritten as 
X = 



^i(...,,.),./(l^i(...,,OA.J^) (k<ln) 
^i(..,+.,0,*/(l^'(«..+.,.)ArJv^^^) (In < k < In + run). 



JEEE4%-w(^^"')^^^p^^',p 



p=0 k,k' K" 



2 00 



2 E E E4,if" 

K,K',K" i,j=lp=0 



■k'(K),y (K') 



W{K")Bk^iK).p ■ W{K)Bk.iK).p ■ W{K'). 



Let 



^K,K',K" — 2 



E 



Vl ,V2,V3>0,Vi-^V2--\-V3—V p—Q 



for I < i,j < 2, then F^^'j!^, ^„ = i^^''^ ^//- Hence for general U and any g g 2N, we have 



j,j=l ^ ^ K.K'.K" 



K ^ K' 

r ^ 00 



k.k'.K' 



p=0 



-c\ Eivi( Ei^o,.'i^i? ( .:l"^^^!!r'!'°w^.^' 



p=0 



■\/I^O,fe|\/|^0,fc' 







)' 


n 






)' 


n 



2 , £ 
<j \ 2 



n 



by Lemma [T^ 



25 



Moreover, by Lemma [TUJ we have 

E[\dix\'i\ii] < Ci?[i?c',,„(T)-('^+^)?|n]|(' l^"'lE 

^ k,k' ,K" "-fi 
/(Mp)fe.fe 



k ^ k' ^p=0 



k,k',K" p=0 
2\ 4\ 2 



{p + 1)2'- 



Ei^"^4E E 



1 



k' ^ p=0 



S2p + 2,f!nflo ,./7^0 



2r 



ix 2 



2 \ \ 2 



Since (J^peN'^p)^^''' < EpeNO^P^^ > (p G N) and q' > 1, we have 



E[\d:x\'^\u] < Ci?[i?^s„(T)-(''+^)'|n] 



EE>o,.'Jv/iVii E 



k,k' p=0 

QO 



Pl,P2=0 



{Mp)k,k'\02p+2.k\ 
(p + 1)2- 



2p2 + 2,fc^ 



(pi + iY(p2 + 

k k[,k'2Pi,P2=o ^-^^ ) ' ) 

Therefore, £;[|a^A'|?|n] is less than the right-hand side of ^ since || Mp \\< 2, 

E I^O''=l-^*'2pi+2,fc'in0o,fc7^0le2p2+2,^neo.fc#0 < |6'2pi+3,fci n 6'2p2+3,feil, 



E(^p)fc.fc'|6'2p+2,fc| <|| A/p II (/n +m„)5$|p_^2 2 < 2(/„ + m„ ) ^ «'|p+2,2 : 



and 



E E viV'Jviv^i(^^pi)fe,fe;(^^P2)fe.fci <ii A^;,Mp, II ^i^o.fci < 8T. 



We will estimate £'[|i?2|''|n] in the next step. Since 

E[{dl{ZkZk' - Zfc,pZfc-,p))29|n]* < Cq{T V 1){E[R^] + e^)(|02p+2,fe|^ + |02p+2.fc'|^), 
Lemma inland the Cauchy-Schwarz inequality yield 



EWdiR.m] < 4(EE E 



29 ^ ^^1^2! 

A;, A;' p— v\.V2>^^vi-\-V2—v 



tE 









n 



xE 



{di^iZkZk' -Zk,pZk,,p)f'' 



n 



< C( ^^(p+l)'^+l|02p+2,fc|^i?[i?^(l-S„(T))29(2p-5)VO|n]2^(Mp)^_^ 
^ fc,fc' p=0 

\ 9 

X(^;[i?^] +e^)(TV l)(|02p+2,;o|^ + |e2p+2,fe'|^) 
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Hence by the Holder inequality, we have 

S[|9^i?2|«|H] < C(T9Vl)(^[i?^] + eJ;)£;[i?^S„(T)-(2-+2r+3)g|n]^ 

(Mp )fc,fc'(|g2p+2,fc| + |g2p+2,fcr/'|g2p+2,fc'|'/') 



EE 

p=0 ^ fc,fc' 



< c(T« V i){E[R^] + ei;)£;[i?'^s„(r)^(2^-+2r+3)g|n]| 

/ {{In + m„)$2p+2,2)^/^ V 4>2p+2,l ' 



p=0 ^ 



Then £'[|i?2|'|n] is less than the right-hand side of ((20)) . 

Furthermore, by Lemma [S] and the Cauchy-Schwarz inequality, we have 



< c{E[R^] + T'^{ei^y/*)(Y^ ^ / (E^^n^pf -^pf )) 



k.k^ 0<fi <v 



p=0 



n 



(22) 



Since H is independent of {(Xj, {bl)i)}t, we can choose conditional expectation for which 1 1->- E[{J2'^o (^p'.t ~ 

iplt ))^'|n] is Lebesgue integrable almost surely for < vi < v. Therefore, by ([^ and similar argument to the 
proof of Lemma we have 



E[\^:R^m]<c{E[R^]+T'^{el^y/*)^J2 E i E ij2d:^{e,f 

^ k,k' 0<Vi <v ^ L \ p^g 

By Lemma [TUl (P^ . (pij) and the estimates after that, we have 



?kM 

t 



2q 



in 



1 1 



dt 



(23) 



< 



C{E[R^]+T^{Ql^f^)(Y,([ £;[(f;(p+l)^'+3i?2.+9 
x(l - .„(r))(^''-^)^°(Afp),aH^2p+2,..|^(T^ V 1)1«,^^, ,,(t) 



2? 



n 



1 , 1 , 



dt 



< C{E\R^] + T«(e|^)3)(T5 V l)S[i?^s„(r)-(2-+2'^+ 



^^'iniME E 



((A'^p)fe,fe' )^ l^2p+2,fc I |^'2p+2,fc' 



(p+1)^ 



< C{E[R^]+T'i{Ql^)'^){Ti V l)S[i?^s„(r)-(2-+2r+7)g|n] ^ [ ^ 

p=0 



$2p+2a ^ 



(p + 1)'^ 



Then £'[|9^i?i|^|H] is less than the right-hand side of ((20)) . Similarly, we can see 



EWM] < Ci;[i?^s„(T)-(2-+2'-+5)9|n]^(s[i?C] + r«(ei,)3)f ^ 

^p=0 

Hence E[\d^{Z*{M - M)Z/2)\i\U] is less than the right-hand side of ((^. 
Similaly, we can see 



y^{ln +m-n)^2p+2,2 
(p+1)'- 



E 



2^ P 

p=i 



(tr(Z^') - tr(Zp) 



n 



is less than the right-hand side of ([20]) • 
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Moreover, 
E[\d:{fi*MfL/2)\'>\n]<CE 



n 



<Cii;[(i?^s„(T)-(^+i)«)2|n]^(2r)9(ei )3 



t)l=0 ' ^t)2=0 

.(2p— i.)VO ^ r<j}2v^ 



since ^^=0 II ||< Ci?^" Er=o((2p)^ V < Ci?2-s„(T)- 

We will estimate S[|9^(/i*MZ)|9|n] at last. Let £p,fe,fe' = ((L2p)^P - (i>2p+i)^P+^)fc,fc'. /i*MZ can be 
decomposed as 



where 



]i*MZ = '^'^Cp^k,k'i^p,kZk' +^^Cp^k,k'{p.k ~ Jj.p,k)Zk' = Si + ^2, 

k,k' p=0 fejfe' p=0 



Then by the Burkholder-Dcvis-Gundy inequality, we obtain 

vx+V2=v '-^ k' ^ k p=0 ' 

^ ^ E (E^f(EE^^H^f-'=-'''^M))'(^^'^^-')' 

V , , CO 

< cEiR^"]^ E E EE^[(^^^(^p^fc^fc'^p^fc))''in]^ 

i;i=0 ^ k' ^ k p=0 



n 



n 



3. 

q \ 2 



Since 



we obtain 



E[{d:^ {Cp^k.k' Ap.fe))'' |n] ^ < c(2p + i)"£;[i?^p4,(2p-5) 3^ (m^),^,, (el,) 



i?[|a:sinn] < ci?[i?4']^(ei,)^(E E E i?[^V.f^^-''|n]^(pi + ir(P2 + ir 



fc' ki,k2Pi,P2=0 



Then £;[|9^Si|9|n] is less than the right-hand side of ^ since 



J2e[R^p; 



?C-4g(2p-5)|n]3^^^^^^„ < ( E^[^^Pr'^'''"^'|n](p+l)'^^"+^ 
p=0 ^ p=0 

< C£;[i?<^s„(r)-«('^^+5)]i/49. 



E(f + i)' 

p=0 
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On the other hand, Lemma El yields 



n 



< 



< 



y oo 

C£;[i?^](T« V i)((ei^)5 + (e2^)^)( ^£;[i?^p2g(2p-4)vo|n](p + 1)(2.+6)9 



E 

p=0 



- ((4p + l)rnV V ((4p + l)r„)V 2 V'-^ ' 
p+l 



< CE[R%t^'''^\Ti'' V i)(z„ + m„)* ((e^,)^ + (e2,)^)£;[i?^s„(r)-(2-+7)9|n]^, 

where we use the fact r^y rl = T'i{rnT-'^)^ V T^(r„r-i)^ < (^T V l)rZ^^ . This complete the proof of 

We next estimate E[\d^Hl^jT;a) - S^iJ^^ JT; cr)|?|n]. Let J{k) = 1 (1 < fc < /„), J'(fc) = 2 (/„ < fc < 
+ m„) and B^. = j3),J/I^L(eo fc)AT„l 1 < ^ < + m„, « = 1,2. For p G Z+ and 1 < k,k' < In + m„, 

we define {^^^f }, {?7p^'f } as if follows. 



1. the case k = k' 
1 

~2 



-(log iCVj - log Ki:i).j)hp=o} + T-m2prh.k pi%,^,),rjMp)k^k)iip>i} 



1 



4p 



2. the case {k < In and k' > In) or (A: > Z„ and fc' < In)- 



/('r1r2 I R'5'(fc)\ 2p+l pj/lfc) 2p+l 1 



J(fe) 2p+l 



x(Mp)fc,fc,(A./o)fc,fc' + §((i2p+i)'P+^)fe,fe'((^)T)fe,fe' - J tpf -dWt+J 

3. other case : We set ^p'f = and r^^'f = 0. 
Then by Ito's formula, we obtain 

lY^dXltl < + iMp+i)k,k}le.,,at). 

Moreover, we have 



-fe,fe' 



fc.fc' p=0 i- i-' "=n 

Therefore we obtain the conclusion by Lemma [TUl 



/c,/c' p— 



□ 
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Lemma 14. 1. Assume that [A\\^\A2\ hold and {6„ ^(/„ + m„)}„ he tight. Then 

as n oo for < w < 3, where s„ = r^"'^ A ((1 — |po|)/2). 

2. Let < w < 3, 5 € 2N,q > tii, (5 > 1, a?irf {snjneN be stochastic processes which satisfy [S]. Assume that 
[Al],[A2],\AA-{2q),5] hold, 



linisupi;[s„(T)-(2"+2['51+i2)g] ^ ^ lim sup [6,729 (/,^ + mnf] < 00. 

n— J-oo n— J-oo 

T/ze?2 ^/lere exists tiq € N 5wc/i i/iai 



(24) 



sup 

n>no 



< 00. 



Proof. We first prove 2. Since {r„}„ is bounded and r„ as n 00, we have limn~^oo E[r!^] = for 
any q' > 0. Then by [Al], [AA-{2q),S], Lemma [T51 with r = [5] + 2, Cauchy-Schwarz inequalities, Jensen's 

inequality and the estimate $2p+2,2 < ^n(8p + 9)$2p+2,ii have lim„^oo sup^. E[bn'^^^\d'^{Hn — ^^ri)!''] = 
< t; < 4. Hence lim„^oo E[bn''^^ sup^ - Hl)\i] = for < w < 3 by Sobolev's inequality Similarly, 

we have lim„^oo ^^[6™'^/^ sup^ \daiHn " = for < w < 3. 

We estimate H^^ — H^ in the next step. Let < < 4 and H is deterministic. By Ito's formula and symmetry 
of M, we have 

1 /■* 

Hl{t)~Hl{t) = --y^Mk.k'{Zk,tZk',t - {{Z)t)k,k'} ^'Y^M^k' / Zk,sdZk-.s. 

^ k,k' 1- i-' -^0 



k,k' 



Therefore, {d^{H^{t) — Hf^{t))}Q<t<T is the martingale. By the Burkholder-Devis-Gundy inequality, we obtain 



E[\d:iH'^ - H^jn < CEWAHl - Hl))f] iO<v< 4) 



Moreover, 



{d:{H'„-H'J)T<CR' II Mo 



^ \{di^zr\x\\{\d^^Mk,k^}k,k' 

0<jl+j2<V 



where 1(9^1 Z)*|2 ^EfcSupt|a^iZ,,t|2. Since i;[|(9^Z)*|29] < CE[R^i]il„+m^)i ,\\ Mo ||<2and|| {\diMk,k'\}k,k' \\< 
Ci?2J(l - pt)-^-'^ for < j < 4, we have 

6;*i?[|9^(i/i - HlW] < CE[R^]E[{b-\l„ + m„)y/']E[R^{l p^)-2(-+i)9]i/2 
for general H. Then by Sobolev's inequality, there exists no G N such that 



sup E 

n>nn 



sup&„^|a^(i?i-i?2)| 



< 00 



for < u < 3. This completes the proof of 2. 

Finally, we prove 1. Since |$2p+2.i| < C(p+l)Vjj(Z„+TO„) and |$2pi +3,2p2+3| — C'(?'l +1)(P2 + l)(^ri +™Ti)2''n 
for pi,p2 G Z+ and i = 1, 2, by Lemma [T51 with r = 3, we have 

sup E[\dl{Hn{a-,Sn) - Hl,^{T-a))\''\Tl] < C(l + r,;^)(l + r?/^^^^(;„ + m„)t + r|G„ + TO„n 
creQ^inA 

for q G 2N, q > ni and < v < 4. Therefore, by Lemma [TT] 2.. the assumptions and the inequality T = J^i 1^1 ^ 
r„/„, we obtain {b^^^r^^}„ is tight and 



sup b-'mH,,{a; s„) - iJi,,„(T; a))| 
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as n ^ oo for < w < 3. Similarly, we obtain sui>„b-^\d^{Hf^,jT;a) - Hf^_^jT;a)\ -^p as 
< w < 3. 

Moreover, similarly to the proof of 2., we have 



for 



E[\b-^d:{Hl - Hl)\^\n] < CE[R^]b-''/'ib-Hln + m.r,)r/'E[R^{l - prY 



for q > ni and < ?; < 4. Hence by Lemma [TT] 2.. we have 6,/sup^ \d'l^{H^ — — as n — )• oo for 
< w < 3. 

Moreover, since P[t(s„) < T] as 7i oo, 6„;^sup^ |(9^(iJ„(cr) — if„((T;s„))| — >p as n — > oo, which 

completes the proof. □ 

Lemma 15. Assume [A3']. Then 

sup|vl/P.i(/(.,a),ap)|^f and sup\'fP^\f{;a),c^)\^PO 

as n oo for p £ Z+ and /(t, cr) ; random variable defined on [0, T] x A suc/i that f is continuous with respect 
to {t,a). 

Proof. Let {f''}k be step functions such that sup^^ \ f{t,(T) — /'"'(t, tr)! — as fc — )■ c». By [A3'], we obtain 

sup^ I /(f cr)iyP'^ (dt) - /'^(t, a)ap{t)dt\ as n ^ oo for any fc e N. 
Since {f^'^([0, r))}„ is tight, for any e, (5 > 0, there exists K such that 



p 


sup 


I 




a 





{f-f)<'\dt) 



V sup 



(/ - f'')ap{t)dt 



> S 



< e {k > K,n EE). 



Then there exists N e N such that P[sup^ cr), ap)| > 36] < 2e for n > N. Similarly, we have 

sup„ \ W'^{f{-,a),Cp)\ -^P a.s n ^ oo. □ 

Proof of Proposition [3l 

Wc first prove 1. By Lemma [H it is sufficient to show sup^ \b~^d^Hf^{T; a) - d'^h^{a)dt\ -^p as 
n — oo for < w < 3, where s„ = TiV'*'^ A ((1 — |po|)/2)- 



Since P[r(s„) < T] ^ as 7i ^ oo. 



m^sup 

p=0 i=l 



{dlVlit A r{s^),t; a) - d^V^t, t; a))vP^'\dt) 



->P 



as n — >■ oo for < u < 3. 

Moreover, by Lemma [T5l sup^ |^'P'^(9^I?p(-, •; a),ap)\ — s-^ as n oo for p e and < < 3. 

Then by LemmaH the tightness of {^'^'^([O, T))}„, and the estimates vf^^ilQ, T)) < iy°'^{[0, T)) and |5^2?p(t, t,a)\< 

Ci?c^p^'P-'')^°(p + l)^ we have 

OO 

5]sup|vI/P.l(9:i?i(.,.;a),ap)|^P0 
as n — > OO for < w < 3. Similarly, we obtain 



J2snp\^P-\d:vli-r;a),Cp)\^P0 

as n ^ cx) for < u < 3. Since h'^[a) = Y,'^^i^{Vl{t,t;a)ap{t) +V'^{t,t;a)cp{t)), wc obtain 1. 

We next prove 2. First, [S-{{2v+2[S] + 12)q),£] and the estimate i/P^*([0, T)) < !^°^^{[0,T)) < b-\ln+mn) {p S 
Z+) yield 



sup-E 



sup 



OO 2 



p=0 i=i •'^ 



< OO 
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for < u < 3. 

Then by Lemma [Ml it is sufBcient to show that there exists no G N such that 



sup E 

n>no 



sup 



p=0 



91 



< OO. 



sup E 



By [yl3'-(7,?7] ^-iid independence of {n„}„ and X, we have 

6;i^vl/P^i(9:i?i(.,.;fT),ap) 

p=0 

^Er^n^ ^^p Em{{p+if\^''Hd:^'Di{;-;<j),a,)\r 

p=0 ^P' ) n>no 



< 



p=0 



(25) 



for < u < 4, a in [A3'-q, 77] and hq which is renewed if necessary. 
By Ito's formula, we obtain 

Elld^'Dlit, t- a) - dlVlis, s; a^] < CE[{{p + ir+^p^^''-''~^^''''R^nt - s^/^ 

for s <t. 

Hence by Kolmogorov's criterion ([201 Theorem (2.1)) and its proof, we have 

E[io^id:^Vli; •; a))''] < CE[{{p + 1)^+' p^^"-''-^^''" R^'n (26) 

^,<^ yield sup^sup„>„^£;[|6;(^^o*P'i(a^I?i(-,-;cr),ap)|«] < 00. Then by Sobolev's inequality, we have 
sup„>„„ £^[sup^ \bl X;^o *'''H5a2'p(-, •; ap)\''] < 00 for < u < 3. Similarly, there exists m G N such that 
sup„>„^ i?[sup, \bl Er=o ^P''(a^2?2(.^ .. a), 0^)1"] < 00 for < i; < 3. □ 

7.3 Proof of Lemmas [71 and [81 
Proof of Lemma [Tl 

Let G[,^t) {Gij}Lii).L{j)els^t) for < s < t < T, {A^jf^i be the eigenvalues of G[s,t)G*,^t) and f['\t) = 
fi{t,BlBl, psT Ps.*)- Since |6^^tr((G[3^t)Gj'^ ^^p) — ^-^'^([5, i))| — >p as n — > 00 by a similar argument to the 
proof of Lemma [H we have 



/t ' 
aJu)du = P- lim h'^ ^{Kf 

4=1 



where P- lim denotes the limit in probability. Moreover, similarly to the proof of Lemma[21 we have supj |A^| < 1. 
Let gi = Qiips) = a/1 - X'^Ps, 9i,* = 9t{Ps,*)- Then since 



p=0 



p=0 



■J p. p 2 ^ p 
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for p, e (—1, 1), we have 



i=l ^ p=0 p=l ^ ■' 

I' 

P-lim 6;;^ E {1 + Sli?,'5.r'(A^P.P.,* - 1) + \og{BlB^,g,,,gr^)} 



n— J-cxD 



P- lim b-' J2 {BlBlgr\\[p,p,^, - 1) + Blslg^^^gr^ + F{BlBlg,,,g-')] (27) 



i=l 



by Lemma |31 
Since 



ffj [\PsPs,* - 1) + .9i,*.9, = 27j 77 : 7 = 27i r> [ T - -\\Ps - Ps.*) /3 

(28) 



and BlBlg^^^gl^ - 1 < R^/^Jl ~ p\, it follows that 

ff['\u)du < P-lin. 1^(515^3^^^^^^ 

from ([271), dMl) and Lemma HI 
Moreover, since 

{BlB^,g„gr' - if > [BlBlg,., - g,f > gl^B^ - 1)V2 - {g^ - g^,*? 

^ glMBl - l)V2 - {KfiPs - Ps.*?{Ps + Ps.*f/{g^ + g^,*f 
> (1 - pl){BlBl - lf/2 - K{Ps - Ps,.?/{1 - Pll 

we obtain 

f['\u)du 

^ BiBi{ps-ps,.? , 1-4 r(i-p|)(Bii?2-i)2 /■* (p., -p,.,)2 /■* , , , 



^ - ^) {Ps - Ps,.? f a, {u)du iL_3)l^BlB! If 1^ aoiu)du 

< -Ci ^ {ai{u){ps - ps..f + aa(u){BlBl - if] du. 
Since s < t is arbitrary, we obtain 

/■* 

fi{u,BlBl,Pu,Pu,*)du<~Ci / {ai{u){pu- Pu,*f +ao{u){BlBl-lf}du. 



Then we have 

h{t,BlBlpuPt,*)< -Ci{ai{t){pt-pt,.f + ao{t){BlB^-lf} dt x P- a.c. {t,uj). 
Similar argument using the eigenvalues of G'^^ t)^ls,t) instead of that of G[s ()Gj^^ yields 

f2{t,BlBlpt,pt,*) < -Ci{aiit){pt ~ pt,*f + co{t){BlB^ - 1)2} dt x P- a.e. {t,uj). 
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□ 

Proof of Lemma [8j 

For the case that observation intervals {/}, { J} are synchronous and equi-spaced : |/| ~ \ J\ ~ T/[bn], we 
obtain oq = cq = ai = 1, A{p) = — p^)- Let us denote yt by yt.o for the synchronous and equi-spaced 

samphng case, then by ^ we have 



Since B]B^ Jl — pi ^/ yl — pl > R ^\J\ — p"^, by Lemma Inland similar argument to ([^5)) . it follows that 



Since 



{BlBUl~plJ\l-pi~lf < 



< 



2{B^Bf-lf+2{^l-pl^-^/l—^y^ 
l-pl 

2{B]B^,-lf {Pt..-Pt?{pt,.+Pt? 
\-p\ + 2(l-p|,)2 



there exists a positive random variable IV which does not depend on a,a^,t such that E[{TZ')''] < oo for any 
q > and 

ytfi > -n'{(B] - B^f + {BlBj - If + {pt - pt,*f} . 

By integrating with respect to t, we have the desired conclusion. □ 

7.4 Proof of Proposition [5] and Theorem [2] 

Proof of Proposition [5l 

We use Theorem 2 in Yoshida j38j . 

Let /3i = (5, /32 = 1/2 - (5, < < 5, < a < 1 A {p'2/2), /3 = a/(l - a) and < pi < 1 A /3 A (2/3i/(l - a)). 

Let 

y„{a; a,) ^ b-\Hn{a) - i?„(aO), f „(a) = -b-^dlHn{a), 
then it is sufficient to prove the following five conditions for any L > 0. 

1. There exists cl > such that for any r > 0, we have P[x < r^'^'a^^")] < Chjr^ and P[{r^''i|up < 
w*ru/4 for any u e M"i}'=] < CL/r^. 

2. For A/i = L(l - p\Y^ , sup„ £;[(fe,T'/'|9,i?„(a,)|)^^i] < 

3. For A/2 = i(l - 2/32 - p^)-\ 

Ma 



supi? 



sup 6^ ''^|3^n(cr;CT*) -3^(ct;ct*)| 



< CX). 



4. For M3 = L(/3 - p\)-\, sup„ £;[(6-i sup, |93H„(a)|)^^3] < 

5. For M4 = L(2/3i/(l - a) - p'i)-i, sup„ E\{hi^\V ^{a - V\Y'^\ < 00. 
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By using Taylor's formula for hf{(j) — h'^{a^), we obtain x < infueK"i\{o} u*Tu/{2\u\'^). Then [H] yields 1. 



Moreover, 3. and 5. obviously hold by Proposition[3]2. By Proposition[3]and the estimate E[{sup^ \ d^h'^{a)dt\) 
oo, 4. also holds. Finally, Lcmma[T31 [S-q' , 2q'S] for some sufficiently large q' and the estimate daHf^{T\ cr*) = 
on {r(s„) = T} show 2. □ 

Proposition 10. Assume [Al] - [AA\. Then (V„(mi),--- ,V,i(itfe)) (V(mi),--- ,V(wfc)) as n ^ oo for 

ken,ui,-- - ,Uk e M"S where V„(u) = bn^^^d^H„{a^)u + b-^u*dlH^{a^)u/2, V{u) = u^Ti/W- M*ru/2 and 
A/" is defined before the statement of Theorem\^ Moreover, 



Pt,* J Pt,* 

2(ao(t) + Aipt,.))id,Bl,f ~ 2(co(t) + Aipt,*))id,Bl,f . 



Proof. By ([7]) we have 



d^hr = -d.BlBliao + Aipt)) - - _ liB^fdMiPt)) 



+ (a<,Bii?? + Bjd^B^^ + BlBfpt^^d, + + + ^^d^pt 

Pt \ Pt J Bl Bf Pt 

d^BlA{pt) (^Bf^ - Bl^ + d^BfAipt) {bI^^ - + aod^Bl (^J^ - B} 
.e.3.Bl (i, - Bl) . 3MiPt)) {BlBf-^ - ^ - ^) + - ^.^^?^) 



t,* 



B^ t, — 1 and each term of the right-hand side of the previous equation has a factor which equals 
if we substitute cr = cr* , it follows that 

dlh^{a,) = {d,Bl^d,Bl^+ d^Bl^d^BlM* - {{d.Bl^Y + {d,Bl^Y)A. - {d,^^^^^ " 



Pt,* 

-2aoid,Bir - 2coid,Bir d.Aip^,*)^^^^ + ( ^ - d^Bl - d^Bl] 

Pt,* Pt,* \ Pt,* ' ' / 

= A* (^^-d,Bl,-d^B^,) ~ dpAipt,*) - 2(ao + A*)id,Bl,f - 2(co + A*){d^Bl 

\ Pt,* ' ' J Pt,* 

where A* = A{pt,*)- 

On the other hand, for u e R"i, let s„(i) = (1 - pt)/2, Ti = bn^'"^ {daH{a^) - d^Hnia*] s„))u, Ts = 
b-'/\d^Hn{a,;s,,)+Y,^^^^{-iyd„Hl,jT-,a*))u, T3 = b-'u*dlHn{<J,)u/2+u*ru/2,T4 = b'^'^ d„Hl,^[T- a*) 
and Xt = Xt,n{u) = bn^'\d„H\^,^{t-a,) - d„Hl,Jt;a,))u. Then 

I 4 

V„(U) = XT,n{u) - -U*ru + Y,^J- 

J = l 

As n — > OD, since P[r(s„) < T] ^ 0, we have Ti 0. By [Al] — [A4] and Lemmas [TT] and [T51 with q = 2,we 
have T2 0. Furthermore, we obtain T3 -^p by Proposition |31 Moreover, T4 — J-^' since P[r(s„) < T] ^ 
and d,Hl,^iT;a,) = on {t(s„) = T}. 

Then it is sufficient to show 

1=1 i=l 

as n — ^ 00 for any vi, - ■ ■ , 1;^ € R and ui , • • • ,Uk € 
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Let J-t = nt'>t{J't'\/'j{{nn}n)} for t e [0,r) and = J'T\/<y{{Un}n)- Then {W^t, J"/}o<t<T is also a 
Wiener process and {Xt{u), J^t}t is a martingale for u e R"i. By Theorem 2-1 of Jacod [H], it is sufheient to 
show that 

(i'.,„(M))t ->f u*rtM, (i'.,„(M), w^)t 0, (i'.,„(w), A^')t o 

as n oo for any t e [0,T], u e M"i and N' e Mb{W^), where = - dlhf{a.^)ds and Alfc(iy-L) is the 
class of all bounded J^/-martingales which are orthogonal to W . 
By Ito's formula and symmetry of M , we obtain 



Hence it is obvious that {X,N')t = for all N' G Mb{W^) 
Moreover, 



BlJs + Op{l) 



for 1 = 1,2, where J'(fc) = 1 (1 < fc < = 2 {Ui <k < 1^ + rrin) and 



fc2) lgQ,fc2 (■^) 



r(s„)l 



fc2 l'l+t'2+f3 = l 

On the other hand, we have 



fc2l 



< b-'E 



E 



k.k' 



'■""■"^^ Bl sds 



VroJcTvroJc' 



R^Y.^Mo)k,k' f I \Bl^,^\\Bl,^,^\ds^ds2 <h-'E R^Y.{ I \^kJds 
k k' Jo Jo J L \ Jo 



as n ^ oo since |5^(M)fc,fc,| < - pj,)-(-+5/2)M(, fc,, where A'/(.fc., = E^=oiMp)kM' / ip + I? ■ Hence we 

have (A", W)t as n ^ oo for any i g [0, T]. 

Then it is sufficient to show {X{u))t -^^ u^Ttu as n -> oo for any t e [0, T] and u £ 



= ^T^^^* E / 

ki .k2 M^jk^ ^ 

Z.- u . 



da I A/fcj^fcjZfcj^s 



LJ(fc2 



|LJ(fc2) I 

' 7' 



( 7 ^^^^ ^ 1^0,^2 ngo..,(^) , 

Oct Mfc, fe.Zfc, s TFTT-^ — , — , 05 



■ BksM 



^'kl.S^'k3,S Ieo,fc2n0o,fc4 (*) 



/ci ,A:2 ^^3 ,^4 



ds + Op(l), 



(29) 



where Bk,M = MMk^MKlt^i^^^risJ-'^^^^^^^^^^ and Zi^ = /^.^^^^^ 6^ 

Ito's formula yields 



7' 7' 

^ki,s^k3,s 



J(k)^ 



(30) 
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Moreover, let 



then we have 



Ir f M ^ /-<d10/1 - \-7 \ ^ \ ^ -^^fci,fc2-^"^fc,fc4"'"^ll,fc2nSo,fc4 ('^) I „/ II |2 

sup\Fk{v,s)\ <CR"{1- pt) 2^ Z^^T^^ — r /T7i r at; — r /T7r- =f '^^P l^fci.^H"! 



and therefore 



Then we obtain 



/ E[sup\Fkiv,s)f\n„]ids < C\u\^\do,k\-'^^y2{M'MoM%,,k. 



fei 



E 



E 



t nt 



Fk{v,s)dZi,Js 



"'0 









n„ 



fc.fc 



E 



, Jo JO 



Sl AS2 



dsids2 



< E[R^]^Y,\9o.kneo,k'\ f E[snp\Fk{v,si)\^\n^]ids, f E[snp\Fk,iv,S2)\^\Tl„]ids2 

k,k' " -^0 " 

< C|u|4 ^(Mo)fe,fc' iM'MoM%,^kiM'MoM'),,,^^k' < C\u\\L + m„) = Op{bl). 



Hence we obtain 



,. JO Jo 



as n — > oo by Lemma [TTl 
By we have 



U U 7, 7, 



k\ ,A;2 ,^3 ,^4 



Let 



Lpipi,P2) = 



Pi(GG*)P -P2(GG*)PG 
-P2(G*G)PG* Pi(G*G)P 



y£„ 



p=0 



and 



= 



V2l{t) V22{t) 



= V'it)Loil,-pt,*), 



where £i denotes the unit matrix of size /. Then by [A2] and the estimate -P[t(s„) < T] ^ 0, we obtain 



All ,A;2 ,^3 ,^4 

^L(W,L),* ' ^L{eoi^),* Jo Jo leo,fcineo.fc3 (w)leo,fc2neo,fc4 (s)dwds 



l"i(eo,fci),*ll"i(eo,fci),*l 



-U + Op(l). 
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Since for intervals Ki , K2 , we have 



t pS nt PS 

lKAv)lK2(s)dvds + / lK,{v)lKAs)dvds = \{Ki)t\\{K2)t\, 



'0 JO 

then by symmetry of 2?', we have 



kiMMM I L(eo,fci),*ll i(6lo,fci),*l 

= ^6.;;'^* E mL{e,.^))f)u,ku + o,{i). 

fc;L(0o,fc)e[O,t) 

On the other hand, for p G Z+, x, y G M, pi, p2, P* G [^l^ l]j we can write 

Rrr „U r« n \B(t n « ^ - x^p^{GG*Y - xyp2P^AGG*Y+^ {x^p,p.-xyp2){GG*YG \ 
U[x,y)Lp[p^,p2)IJ(x,y}Lo(L,~p.) - (y Vp* - 2;yp2)(G'^G')J'G'^ y^ PiiGG*)P - xyp2p4G*G)P+' ) 

Then for Q^^ = (9^5^!* - 9,^5^2 J + daPt,*/pt,*, Qt = (9^-5*% - d^Bl^) + daPt,*/pt,*, wc have 
2^11 (0 

OO f 

= E C^d.Blpf, + 2pd^pt,.pZ''){GG*r - {{d.Bl + + (2p + mpt,.pZ''')iGG*r-'' 

OO 

= 2d,Bl£i,^ + QlY.pZ{GG*r. 
Similarly, we have 

OO 

t>22{t) = 2d,Bl,Err.,, + QlY^p%{G*GY, 

p=l 

and 

OO OO 

A2it) = -Q?E/^?r'(GG'^rG, 2^2i(t) = -QlY^pt'^'iG^GYG*. 

p=0 p=0 

Then by the estimate ap = Cp {p > 1), [A3\ and Lemma [T51 it follows that 



i;L(/')e[0,t) j;L(,/J)e[0,t) ^ 

= u*^ |2(a<,Bi j2^o(s) +2(5,b2 j2co(s) + (5,S,\,Ql + Qld,Bl,)A{ps,.) 



OO OO 



Pl=0p2=0 



{QlY + {Q's? g f2p^J:i+^P'^ap,^p^is)\dsu + 0p{l). 

Pl=lP2 = l 



Since 

Pl=0p2=0 Pl = lp2 = l 
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we have 

-%^{(Ql - 2d.Blf + {Ql - 2d.Bl^f}ysu + 0,(1) 
= u*Ttu + Op{l). 

□ 

Proof of Theorem (2), 

1. Since A is open, there exists e > such that 0(e,cr») = {a; \a — <t,| < e} C A. For (7„ G 0(e,cr*),wc have 

-daHn{a^) = / dlHn{(y* + u{a-n - Cr,))((7„ - (Tt)du 
Jo 

since daHn{(Jn) = 0. Therefore, for f„ = —b^^ d^Hn{<y* + it((7„ — a^))du, we obtain b]J'^(an — cr*) = 
r~^bn^^^dcrHn{a-st) On {detf„ 7^ and (7„ e 0(e,(7*)}. Then since Proposition [3] and Theorem [1] yield 
P[detf„ = 0] ^ 0, P[<7„ G 0(e,cr*)^] ^ and f -il^^^^p^^^gj p-^, we have bl/^ia^ - cr*) -^'-^ T-^^'^Af by 
Proposition [TUl 

2. Let Sn{t) (1 — pt)/2 for n e N and t G [0,T] and {cr^j}„gN be random variables where cr^ maximize 
Hn{-] Sn) and cr^^ = (t„ on {t(s„) — T}. We first show the statement of Theorem [2] replacing an with cr^. 

To this end, we extend Zn{-] cr*) to a continuous function which is defined on R""^, tend to zero as |m| — >■ 00, 
and has the same supremum as Zn{-\ cr*). We denote the extension of 2„(-; cr*) by the same symbol. 

Let Z(u,CT*) = exp(M^pi/27V- it'^Pw/2) and B{R') = {it; \u\ < R'} for R' > 0. Then it is sufficient to show 
that limsup„^j^ i5[|6y^(cr^ — cr*)|P] < 00 for any p > 2 and Z„(-,cr*) -^^-^ Z{-,a^) in C{B{R')) as 71 00 for 
any R' > 0, by virtue of Theorem 5 and Remark 5 in Yoshida [55] . 

By Lemmas [T4l and IT] and Proposition [3l for any R' > 0, there exists uq £ N such that 



sup E 

n>no 



sup |9„logZ„(w;cr*)| 

«GC(B(i?')) 



< 00. 



Then by Propositions |3] and [10] and tightness criterion in C space in Billingsley [7] which can be extended to 
the one in C{B{R')), it follows that log2„(-, cr*) ^""^ log Z(-,cr*) in C{B{R')) as n ^ 00. 
On the other hand, for any p > 2, let L > p, then by Proposition [5] and Lemma[l] we have 



pmK-<^*)\>r]<p 



sup Zn{u, cr*) > 1 

'-ieV„{r,at) 



Therefore we obtain sup„ E[\bn (cr^ — '^*)\^] < "O- This complete the proof of the statement of Theorem [2] for 
<■ 

We will prove the statement for i7„. By [Al], [A2-q, 5] for any q > 2 V ni, and Lemma[Tl we have P[t(s„) < 
T] = 0{b~^) for any ^ > 0. Then it follows that ^^^((Tn - cr*) -^'^-^ T~^/'^N as n — cx) by the result for cr^ and 
the inequality 

PW'n + < P[t(,s„) < T] - 0(&-«) 

for any ^ > 0. 

Moreover, for any continuous function / of at most polynomial growth, we have 

\E[f{b'J\an - a*))] - E[f{b'J\a'n a*))]| < C{1 + bl/'R"fPK + ^ 
as n — > 00, where i?" denotes the diameter of the parameter space A. □ 
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Proof of Theorem \3[ Similarly to the argument in the proof of Theorem [51 we have P[Hn = Hn{-; Sn)] = 
1 — 0{b~^) for any ^ > 0, where s„(t) = (1 — Pt)/'^- Then by virtue of Theorem 10 in Yoshida j38], it is sufficient 



to show that there exists ng G N such that 



sup E 

n>ni. 



< oo. 



(32) 



By Proposition [3] and Lemmas [T4l and [Tl for any 6 > 0, there exists p £ 2N,p > ni V 2, ng g N and Cq > such 
that 

sup E[\Hn{a, + h-^l'^u) - < Co\u\P 



n>nn 



for any u G U'{S) where U'{d) = {u e 



< 6 {i = 1, . . . , ni)}. Then we have by Lemma 2 in Yoshida 

□ 



7.5 Proof of Propositions E] - [HI 

First, we look back Rosenthal- type inequalities in Doukhan and Louhichi |10| (Theorem 3 and Lemma 7). 

Theorem 4. (Rosenthal-type inequalities) Let q > 2 and q CzN. Let {X^}„gN be a centered process, ag = 1/4 
and 

ak= sup sup sup \P{Af^B) - P{A)P{B)\ 

i,jeN,j-i>k Aeij{X[-l<i) B£a(X'^;m>j) 

for A; e M. Suppose at — >■ (fc — oo). Then 



E 



< 



29(2(7-2) 
(9-1)! 



^ j {a-\u) A nY-^Q\,{u)du \ V f ^ j {a-\u) A n)Q\,\u)d 



Proof of Proposition [6l 

In this proof, we set general constants denoted by C do not depend on n, p, /. 
By Lemma [2J we obtain 

{{GG* f)ii V {{G*GY)jj <|| {GG*Y II V || {G^GY \\< 1 

for p e Z+. Hence 6„J/P''([tfc_i, tfc)) < A^;^ - A^;^_^ + 1 for 1 < < [6„], p e Z+ and i = 1,2. Therefore we 
obtain 

sup E[ max \bni^P'\[tk-i,tk)W'^^+^^] < sup£;[max(M - NI ^ + l)9(i+*)] < C (33) 

for sufficiently large n by [Bl-{q{l + 5))]. 
For /i > and A; G N, let 

= ni=i,2 n;g[i^pAh-i(T-t)]nN {w; A^t+;/i - Nl^^i_^^f^ > 0}, 

^/^'t = (^i=i,2 r^ie[i.p/\h-H]m W'^ ^t-{i-i)h - ^t-ih > 0}j 

where = SI. 

Fix p e Z+, i = 1, 2 and a /3— Holder continous function / on [0, T]. Then we have 

^n\[tk-l,tk))'^ Al ^ € ^"fc-2-[(2p+l)/i])V0,(fc+[(2p+l)h] + l)A[6„]- 

Let a-\u) = Er=o l{a2>«}, /^^ - fti_,, <5' = (1 + (5)/(2(l + <5 - e5)) and 
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then by Rosenthal-type inequalities, we obtain 



E 



k=l 



2«^2(2g-2)! 



k=l 



k=l 



^ / {a-'iu) + 2[i2p+l)b';]+3)Qj,,iu)di 



< C6-'[5„]9/2sup [\a-\u) + 2[{2p+l)bf^]+3y-^Q''^, {u)d' 



k Jo 



k Jo 



sup / Q'l^}+^\u)du 



For sufficiently large n, since ^ and §^ hold, g^;^+ '(li)dw E[\X'^\'i'-^+^^, {x + 1)9' - x'^' < q'{x + 
l)?'-! {x >0,q'> 1) and a"i(M) = fc' if a^, < it < a^,_i, we have 

„ 1 OO CXD 

Jo ^.^-^ ,._n 

for g' > 1 and 



k=0 



E 



k=l 



<c{p+ir-^bf *sup|/tr. 



On the other hand, 



E 



[K] [b„] 

Y,fk<-'i[tk-i,h))\A^ < [b„]-'Y.'upE[\Nl-Nl_^+l\'^^'+'^]rhsup\M'^P[iAl. 



k=l 



k=l 



Moreover, by [B2-{qe)], we obtain 



PUl ,,01 < 4(2p+ 1) sup supPW 



t+[b„]-^b^^T 



Hence we have 



E 



[br.] 



' * I. hO' 



k=l 



Therefore we obtain 



E 



k=l 



Ni^O]<C{p+l)b-'''''. 



<C{p+l)bn snplftl" 
t 



<cip + iy-Xr^^p\ft\''- 
t 



(34) 



Furthermore, Holder continuity of / and ([55)1 yield 

[b.] [b. 



E 



E r (/* - fk)d<^' ^ M'-iu;0(/)'E(T^[^"]~')'^£^K'([^fe-i'i'^))1 < Cb-'^^Mfr- (35) 

A:=l"^*fc-l -I fc=l 



By dSll) and ([33), we have 



E 



Jo 



<C(p+l)'^-i6-"'{sup|/,r+c.^(/)'^}. 



(36) 
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Since p S Z+ and i = 1, 2 arc arbitrary, we obtain [A3'-q, 77] by ([T^ and 



□ 



Proof of Proposition [3 

1. For > and 1 < i < [5„], let 



ip 42p+i,+ ;2p+i - 



Then cj e and < i?(6'o,fc) < t» imply lOp^k] < j{^P + 2)[6„]-iT for w G 17, 1 < A: < /„ + m„, 
n G N, < z < [6„] and j G N. Moreover, j ~ fl ii j is sufficiently large for each i and p. Therfore, for 
AN., = TVi - Nl_^ + Nl - Nl_^ and = \ Ujrio^/. ^e obtain 



< S 



EEj'-(4p + 2)N-'rAiv,i^p 



E E I^MlEi^r 

»=i fc;_R(eo.fe)6(t.-i>t.] i=i 

00 

< [^»]'''EEj'' ■ (4p + 2)'T''[6„]-'i?[(A7V,)''lA?,] 
i=i j=i 

for p G since {A^^ jj-gN are disjoint. Then by [Bl-[p'iq)\, [i?2-(p2(9 + 2)], the Holder inequality and a similar 
estimate for /j)*^] in the proof of Proposition [6l we have 

E[{%.iY] < cM-'EE^"'(4p+2r^PL-i)i'^'^ < c{p+irY.jHc{p+i)rp'^^''+'^y^ < c{p+ir+' 

i=l j=l j = l 

for sufficiently large n. 

In particular, by the Holder inequality and Jensen's inequality, we have 



E 



''n 

p=0 



(p+l)9'+3 



1 



^,iv + iY\{p + iY+i' 



Therefore [AA-q' , (1 + 3/q')] holds since r„ — by the next Proposition |S1 
2. The proof is similar to that of 1. For sufficiently large n, we have 



< \bJ^''E 



EE E T.\^P^M\^\Op.M\^ 

[b,.] 00 

EE{(4pi + 2b- A (4p2 + 2)j}^[6„]-^T« (A7V,)3 



^ ( E(^rti + (2pi+2p2 + l)i[6„]-iT)AT - ^('ti_i-(2pi+2p2+2)i[b„]-iT)Vo) ) ^^pi+^P2 + i 



< C[6„]-i J2 E{(4P1 + 2)j A (4p2 + 2)j}«{(4pi + 4p2 + 3)j + l}3p[(i^';^.+2P^+i)=]^, 



Since (a A 6)(a + 5) < 2ab (a, 6 > 1), we obtain 



i?[(^p,.P2)'/'] < CY^iPl + 1)Hp2 + lf^f{C{pi +P2 + < C(pi + ir^^+\p2 + 1)^/'+^ 
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□ 



Proof of Proposition 

Let A'j = -^^^-1 q"^''^ fo'' i I^- Then since r„ < 2jb^^^ on A'j, for sufficiently large n, we have 



E\r^J ^ E 



1 

n ; 



where A'q 



□ 



Proof of Proposition [9l 

By [S2-g], there exists TV e N such that 



sup max sup P[iV;+jvffcj-iT - ^* = 0] < 4- (37) 



n>rao ^' 0<t<T-Af[fc„]-iT -^^ 



For M ^ [bn/3N], h [bn]~^T and 3kNh, we have 

/,./ ' " ' k=i i,j-Lme[s 



\I\\J\ 



Let 



and 

for 1 < fc < M and j E N. Then for sufficiently large j, A^, = O. Moreover, for sufficiently large n, we have 
inf i<fe<M P[Ek] > 3/4 by ^ and 



I7"IL7"I - 



i=l /,J;L(/)e[sfc_i,Sfc) 

For ?■ £ N and u > 0, we have xf + . . . + xf. > u-^/r when Xi > {1 < i < ?■), xi + . . . + x.,. > u. Hence 

where AiV^ = iV]^ - 7VJ^_^ (1 < fc < Af, i = 1, 2). Then we obtain 

^yL[^>6-iyyX' a.s., where X' ^ /^^^''^ . (38) 

On the other hand, Theorem 2] and a similar argument to the proof of Proposition [S] yield 

Cbn 



E 



M 1 



< 
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for j G N and sufficiently large n. Therefore 

oo AI 

^T'EE(^.'fc-^[^i.fc])^'0 (39) 
i=i fe=i 

as n — > oo. 

([551) and dsn) yield 

oo M 

ai > limsup6-i^^ii;[Xj_,]. (40) 

n— >oo -17 1 

J = l fc=l 

Furthermore, since {A7V^}i<fe<M,i=i,2,n>ni are tight by the assumption, there exists R' > such that 
sup„>„,,fc,, P [ANl > R'] < I/ST Consequently, 

sup P [{ANl + ANl + 1)"^ < (2i?' + 1)"^] < 1/4. (41) 
On the other hand, by [B2-q\, wc obtain 



P 



^T=j+iK < PUir]<Q sup P[Nl^j^~Nl = 0]<CJ~'^ 

n>nn,t,i 



for J e N and n > uq. Thus, there exists J which does not depend on n, k such that 



P 



u/=iiij =l-P[u-,+iiiJ >| (42) 
Therefore by (gOl) , dH]) , (021) and the estimate infi<fe<A/ P[Ek] > 3/4, we obtain 

ai > -, -7- lim sup b„ M • — = -r- . 

- 9TJ{N + Jf n^oo " 2i?' + 1 4 36TJ(Af + J)2 3iV 

□ 
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